-- Logs begin at Fri 2022-06-03 12:15:22 UTC, end at Fri 2022-06-03 13:35:46 UTC. -- Jun 03 12:53:25.376651 dv-cinder-779540-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 12:53:25.386226 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 12:53:25 2022] *** Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: nodename: dv-cinder-779540-3-iscsi Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: machine: x86_64 Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: clock source: unix Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: pcre jit disabled Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: detected number of CPU cores: 4 Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: current working directory: / Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: detected binary path: /usr/bin/uwsgi-core Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: your processes number limit is 47680 Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: your memory page size is 4096 bytes Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: detected max file descriptor number: 2048 Jun 03 12:53:25.388813 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: lock engine: pthread robust mutexes Jun 03 12:53:25.389784 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: thunder lock: enabled Jun 03 12:53:25.389784 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 12:53:25.389784 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 12:53:25.432257 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: Python main interpreter initialized at 0x55d88b2db9c0 Jun 03 12:53:25.432257 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: python threads support enabled Jun 03 12:53:25.432257 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: your server socket listen backlog is limited to 100 connections Jun 03 12:53:25.432257 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: your mercy for graceful operations on workers is 90 seconds Jun 03 12:53:25.432631 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 12:53:25.432708 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: *** Operational MODE: preforking *** Jun 03 12:53:25.432981 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: *** uWSGI is running in multiple interpreter mode *** Jun 03 12:53:25.432981 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: spawned uWSGI master process (pid: 103145) Jun 03 12:53:25.433187 dv-cinder-779540-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 12:53:25.434411 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: spawned uWSGI worker 1 (pid: 103146, cores: 1) Jun 03 12:53:25.434411 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: spawned uWSGI worker 2 (pid: 103147, cores: 1) Jun 03 12:53:25.434411 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 12:53:26.643765 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 12:53:26.647516 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 12:53:27.349307 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 12:53:27.349307 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: from cryptography.utils import int_from_bytes Jun 03 12:53:27.349653 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 12:53:27.349653 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: from cryptography.utils import int_from_bytes Jun 03 12:53:27.360064 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 12:53:27.360064 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: from cryptography.utils import int_from_bytes Jun 03 12:53:27.360366 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 12:53:27.360366 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: from cryptography.utils import int_from_bytes Jun 03 12:53:29.903470 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 12:53:29.904032 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 12:53:29.904131 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 12:53:29.904484 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 12:53:29.904737 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 12:53:29.905150 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.905485 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.905803 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.906248 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.906586 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.906899 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.907204 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.907520 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.907852 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.908116 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.908427 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.908755 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779540-3-iscsi {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.909078 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.909172 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 12:53:29.909556 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.909649 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 12:53:29.909745 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.909945 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 12:53:29.910046 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.910280 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.910382 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 12:53:29.910571 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 12:53:29.910667 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.910893 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.910983 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.911269 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.911391 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.911589 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.912601 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.912702 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.912773 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.912855 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.912931 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.913041 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.913121 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.913197 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.913265 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.913331 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.913412 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.913488 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.913654 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.913737 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.913934 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.914090 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.914280 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.914423 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779540-3-iscsi {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.914585 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.914674 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.914916 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.915012 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779540-3-iscsi {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.915232 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.915327 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.915548 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.915645 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.915850 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.915941 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.916170 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.916306 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.916474 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.916573 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.916850 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.916979 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.917169 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.917287 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.917489 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.917590 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.917793 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.917890 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.918136 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.918283 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.918456 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.918553 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.918776 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.918911 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.919121 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.919221 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.919373 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.919463 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.919679 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.919766 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.919988 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.920089 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.920303 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.920406 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779540-3-iscsi {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.920604 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.920702 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.921018 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.921325 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.921543 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.921638 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.921865 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.921960 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.922264 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.922373 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.922589 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.922692 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.922837 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.922938 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.923083 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.923210 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.923397 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.923533 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.923715 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.923838 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.924022 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.924167 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.924329 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.924485 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.924634 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.924800 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.924938 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.925119 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.925243 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.925424 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.925548 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.925734 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.925885 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.926038 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.926163 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.926382 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.926472 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.926684 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.926772 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.926986 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.927082 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.927232 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.927374 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.927536 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.927695 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.927855 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.928090 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.928181 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.928344 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.928488 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.928652 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.928742 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.928968 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.929064 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.929284 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.929372 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.929588 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.929689 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.929894 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.929981 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.930239 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.930329 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.930549 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.930646 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.930855 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.930943 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.931160 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.931246 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.931460 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.931555 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.931763 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.931862 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.932064 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.932159 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.932310 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.932397 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.932662 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.932761 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.932906 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.932993 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.933223 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.933313 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.933527 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.933622 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.933833 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.933957 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.934157 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.934289 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.934458 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.934553 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.934760 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.934847 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.935064 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.935160 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.935368 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.935455 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.935672 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.935771 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.935978 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.936066 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.936280 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.936393 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.936610 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.936785 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.936986 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.937095 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.937308 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.937418 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.937631 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.937727 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.937955 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.938041 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.938288 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.938395 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.938587 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.938690 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.938890 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.938986 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.939196 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.939300 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.939499 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.939596 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.939804 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.939891 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.940107 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.940194 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.940406 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.940503 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.940710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.940816 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.941007 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.941103 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.941309 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.941410 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.941613 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.941699 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.941915 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.942000 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.942243 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.942337 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.942540 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.942626 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.942844 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.942942 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.943145 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.943234 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.943450 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.943536 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.943754 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.943841 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.944056 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.944144 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.944355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.944441 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.944653 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.944737 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.944955 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.945052 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.945254 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.945341 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.945555 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.945651 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.945854 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.945941 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.946189 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.946278 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.946496 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.946584 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.946798 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.946887 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.947098 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.947184 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.947401 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.947496 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.947703 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.947788 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.948017 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.948104 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.948315 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.948412 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.948618 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.948706 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.948931 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.949018 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.949236 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.949332 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.949541 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.949628 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.949842 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.949936 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.950162 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.950266 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.950467 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.950555 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.950771 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.950859 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.951072 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.951160 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.951373 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.951460 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.951669 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.951756 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.952005 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.952124 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.952561 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.952873 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.953006 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.953187 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.953303 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.953494 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.953591 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.953804 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.953919 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.954127 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.954239 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 12:53:29.954454 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.954552 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.954785 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.954881 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.955109 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.955212 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.955420 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.955516 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.955755 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.955876 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.956089 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.956211 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.956398 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.956494 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.956707 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.956809 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.957025 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.957116 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.957331 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.957417 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.957641 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.957738 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.957947 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.958035 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.958286 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.958377 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.958622 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.958711 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.958918 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.959027 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.959238 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.959346 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.959549 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.959637 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.959862 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.959950 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.960168 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.960260 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.960479 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.960575 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.960786 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.960874 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.961113 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.961208 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.961425 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.961526 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.961735 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.961823 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.962045 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.962163 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.962386 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.962491 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.962697 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.962784 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.963011 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.963124 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.963323 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.963434 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.963628 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.963725 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.963935 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.964032 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.964238 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.964334 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.964546 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.964643 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.964847 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.964943 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.965163 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.965260 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.965479 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.965582 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.965783 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.965885 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.966090 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.966210 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.966423 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.966532 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.966730 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.966819 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.967038 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.967127 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.967342 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.967430 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.967762 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.967884 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.968082 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.968226 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.968392 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.968490 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.968701 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.968796 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.969026 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.969131 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.969338 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.969446 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.969640 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.969739 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.969943 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.970037 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.970275 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.970365 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.970581 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.970681 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.970884 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.970970 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.971188 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.971274 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.971495 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.971583 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.971804 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.971892 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.972109 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.972197 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.972431 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.972520 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.972732 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.972818 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.973040 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.973183 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.973352 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.973440 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.973659 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.973745 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.973964 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.974052 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.974313 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.974402 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.974621 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.974707 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.974933 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.975030 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.975234 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.975329 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.975543 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.975631 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.975844 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.975941 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.976144 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.976230 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.976448 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.976555 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.976743 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.976844 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.977041 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.977129 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.977343 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.977430 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.977644 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.977740 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.977945 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.978033 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.978270 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.978360 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.978590 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.978679 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.978898 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.979005 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.979200 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.979307 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.979503 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.979601 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.979804 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.979909 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.980134 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.980230 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.980440 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.980537 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.980764 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.980877 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.981080 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.981177 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.981379 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.981483 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.981686 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.981781 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.981987 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.982099 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.982326 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.982423 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.982623 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.982713 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.982929 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.983028 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.983382 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.983494 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.983588 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.983886 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.984048 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.984192 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.984358 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.984508 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.984660 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.984815 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.984968 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.985138 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.985294 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.985445 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.985602 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.985762 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.985905 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.986065 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.986250 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.986402 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.986537 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.986744 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.986883 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.987073 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.987171 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.987388 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.987512 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.987707 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.987844 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.988015 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.988162 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.988327 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.988485 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.988632 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.988796 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.989005 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.989106 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.989245 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.989401 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.989555 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.989709 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.989874 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.990014 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.990202 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.990348 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.990519 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.990664 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.990825 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.990972 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.991142 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.991288 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.991449 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.991597 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.991764 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.991917 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.992063 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.992224 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.992372 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.992540 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.992697 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.992842 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.993025 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.993154 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.993329 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.993494 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.993642 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.993822 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.993961 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.994154 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.994293 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.994476 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.994600 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.994788 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.994908 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.995099 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.995210 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.995404 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.995501 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.995711 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.995802 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.996017 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.996108 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.996323 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.996412 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.996636 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.996767 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.996941 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.997031 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.997252 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.997340 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.997556 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.997644 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.997856 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.997951 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.998178 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.998271 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.998490 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.998595 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.998787 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.998875 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.999156 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.999274 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.999477 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.999698 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:29.999796 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.000033 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.000124 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.000346 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.000435 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.000659 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.000748 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.000966 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.001062 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.001266 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.001356 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.001568 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.001658 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.001868 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.001956 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.002193 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.002297 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.002500 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.002589 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.002809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.002897 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.003120 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.003219 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.003425 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.003512 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.003734 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.003838 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.004033 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.004131 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.004338 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.004425 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.004645 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.004733 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.004944 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.005041 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.005245 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.005334 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.005552 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.005638 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.005861 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.005950 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.006189 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.006282 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.006500 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.006595 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.006807 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.006904 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.007107 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.007206 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.007410 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.007506 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.007715 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.007803 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.008021 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.008108 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.008318 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.008406 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.008969 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.009064 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.009260 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.009357 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.009601 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.009826 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.009980 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.010189 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.010280 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.010506 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.010594 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.010822 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.010912 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.011128 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.011215 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.011439 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.011535 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.011748 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.011844 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.012054 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.012151 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.012372 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.012466 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.012682 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.012785 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.012987 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.013074 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.013291 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.013379 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.013589 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.013728 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.013894 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.013982 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.014220 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.014310 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.014548 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.014653 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.014850 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.015157 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.015325 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.015461 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.015647 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.015763 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.015963 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.016053 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.016277 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.016374 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.016590 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.016688 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.016910 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.016998 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.017225 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.017478 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.017576 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.017817 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.017913 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.018133 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.018223 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.018442 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.018543 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.018741 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.018829 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.019040 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.019128 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.019382 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.019478 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.019683 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.019778 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.020025 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.020114 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.020350 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.020521 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.020663 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.020761 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.020975 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.021082 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.021263 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.021361 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.021570 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.021658 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.021870 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.021957 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.022197 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.022306 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.022496 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.022592 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.022807 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.022918 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.023106 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.023226 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.023401 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.023491 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.023705 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.023808 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.024006 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.024095 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.024312 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.024401 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.024617 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.024713 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.024914 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.025010 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.025216 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.025305 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.025512 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.025600 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.025823 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.025920 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.026138 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.026228 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.026437 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.026524 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.026737 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.026825 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.027041 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.027128 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.027344 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.027442 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.027645 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.027734 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.027950 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.028040 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.028248 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.028345 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.028559 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.028647 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.028859 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.028947 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.029157 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.029258 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.029456 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.029544 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.029760 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.029848 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.030067 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.030253 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.030526 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.030853 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.031019 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.031166 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.031358 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.031470 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.031670 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.031768 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.031988 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.032078 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.032301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.032398 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.032614 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.032703 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.032920 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.033007 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.033222 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.033318 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.033531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.033622 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.033827 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.033915 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.034162 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.034254 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.034468 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.034555 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.034766 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.034866 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.035062 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.035150 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.035366 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.035454 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.035665 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.035764 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.035962 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.036057 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.036258 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.036344 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.036555 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.036655 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.036851 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.036943 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.037158 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.037245 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.037460 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.037560 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.037757 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.037854 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.038058 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.038194 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.038382 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.038472 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.038682 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.038781 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.039006 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.039095 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.039316 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.039406 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.039620 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.039730 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.040158 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.040258 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.040357 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.040442 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.040524 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.040605 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.040782 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.040891 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.041089 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.041186 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.041408 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.041497 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.041715 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.041810 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.042013 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.042102 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.042345 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.042445 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.042646 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.042744 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.042945 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.043034 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.043244 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.043330 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.043547 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.043650 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.043849 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.043985 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.044150 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.044247 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.044450 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.044548 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.044755 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.044852 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.045056 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.045153 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.045365 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.045481 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.045672 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.045850 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.046095 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.046339 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.046450 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.046663 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.046769 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.046970 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.047059 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.047314 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.047423 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.047617 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.047705 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.047925 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.048012 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.048237 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.048334 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.048542 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.048630 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.048850 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.048936 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.049156 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.049247 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.049456 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.049550 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.049773 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.049869 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.050077 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.050188 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.050402 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.050497 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.050706 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.050795 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.051010 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.051107 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.051318 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.051406 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.051618 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.051704 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.051940 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.052029 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.052251 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.052339 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.052560 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.052649 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.052879 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.052968 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.053200 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.053289 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.053508 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.053605 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.053814 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.053902 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.054139 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.054239 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.054448 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.054551 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.054753 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.054867 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.055066 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.055180 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.055375 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.055482 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.055685 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.055777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.055997 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.056085 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.056307 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.056404 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.056618 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.056707 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.056928 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.057014 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.057232 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.057335 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.057536 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.057630 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.057836 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.057933 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.058174 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.058265 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.058475 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.058569 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.058795 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.058892 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.059095 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.059209 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.059404 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.059522 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.059706 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.059858 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.060018 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.060245 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.060331 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.060554 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.060728 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.060861 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.061036 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.061184 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.061508 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.061613 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.061864 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.062183 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.062281 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.062492 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.062578 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.062800 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.062886 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.063119 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.063208 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.063437 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.063522 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.063743 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.063828 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.064053 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.064163 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.064360 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.064459 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.064680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.064777 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.065002 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.065098 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.065316 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.065412 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.065641 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.065738 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.065945 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.066039 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.066312 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.066404 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.066618 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.066716 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.066923 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.067026 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.067226 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.067315 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.067552 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.067639 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.067852 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.067950 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.068159 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.068255 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.068462 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.068576 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.068764 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.068888 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.069085 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.069194 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.069387 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.069607 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.069705 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.069918 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.070006 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.070251 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.070359 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.070578 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.070683 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.070883 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.070971 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.071201 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.071295 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.071500 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.071607 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.071810 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.071897 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.072117 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.072206 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.072434 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.072532 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.072752 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.072841 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.073056 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.073151 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.073367 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.073457 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.073669 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.073755 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.073971 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.074059 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.074296 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.074403 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.074602 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.074710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.074929 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.075016 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.075229 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.075340 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.075548 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.075644 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.075876 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.075964 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.076203 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.076293 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.076513 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.076609 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.076844 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.076946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.077262 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.077359 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.077607 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.077922 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.078014 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.078269 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.078362 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.078576 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.078664 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.078876 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.078964 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.079202 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.079293 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.079490 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.079577 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.079792 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.079880 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.080095 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.080195 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.080395 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.080484 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.080694 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.080803 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.080995 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.081084 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.081291 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.081377 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.081609 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.081704 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.081910 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.082000 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.082254 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.082360 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.082557 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.082653 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.082860 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.082948 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.083162 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.083257 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.083460 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.083558 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.083761 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.083848 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.084063 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.084152 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.084365 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.084455 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.084704 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.084802 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.085002 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.085091 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.085326 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.085416 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.085630 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.085717 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.085952 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.086040 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.086295 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.086431 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.086611 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.086712 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.086926 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.087023 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.087241 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.087330 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.087554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.087642 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.087865 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.087970 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.088164 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.088263 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.088467 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.088556 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.088775 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.088910 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.089080 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.089169 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.089383 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.089479 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.089683 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.089903 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.089992 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.090255 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.090348 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.090570 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.090695 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.090875 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.090964 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.091183 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.091270 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.091484 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.091585 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.091794 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.091882 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.092095 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.092181 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.092397 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.092495 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.092771 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.092864 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.093130 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.093227 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.093562 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.093662 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.093863 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.093950 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.094221 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.094316 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.094540 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.094630 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.094861 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.094959 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.095174 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.095262 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.095488 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.095608 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.095797 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.095897 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.096112 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.096209 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.096426 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.096534 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.096740 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.096827 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.097051 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.097149 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.097360 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.097446 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.097671 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.097757 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.097983 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.098083 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.098317 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.098417 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.098623 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.098718 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.098931 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.099042 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.099235 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.099324 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.099541 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.099749 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.099854 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.100077 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.100185 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.100392 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.100489 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.100706 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.100860 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.101014 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.101104 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.101324 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.101413 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.101633 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.101733 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.101940 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.102030 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.102294 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.102483 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.102594 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.102801 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.102891 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.103134 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.103236 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.103461 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.103558 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.103785 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.103886 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.104097 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.104185 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.104416 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.104533 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.104732 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.104828 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.105035 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.105130 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.105337 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.105444 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.105647 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.105744 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.105952 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.106049 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.106277 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.106376 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.106596 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.106686 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.106907 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.106997 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.107210 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.107300 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.107518 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.107606 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.107825 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.107937 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.108139 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.108415 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.108861 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.108958 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.109176 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.109275 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.109501 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.109590 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.109824 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.109913 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.110163 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.110277 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.110471 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.110567 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.110806 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.110903 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.111097 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.111207 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.111398 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.111489 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.111710 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.111798 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.112017 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.112107 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.112318 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.112530 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.112627 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.112847 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.112946 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.113180 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.113270 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.113486 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.113574 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.113790 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.113893 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.114090 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.114198 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.114434 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.114523 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.114738 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.114829 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.115041 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.115138 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.115341 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.115431 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.115649 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.115746 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.115950 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.116039 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.116249 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.116351 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.116547 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.116645 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.116847 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.116936 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.117153 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.117240 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.117448 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.117537 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.117755 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.117852 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.118057 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.118304 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.118484 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.118650 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.118741 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.118966 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.119055 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.119289 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.119380 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.119610 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.119701 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.119911 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.120007 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.120214 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.120303 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.120526 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.120622 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.120828 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.120924 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.121135 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.121251 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.121442 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.121543 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.121744 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.121832 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.122045 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.122166 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.122372 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.122462 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.122678 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.122940 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.123040 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.123267 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.123355 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.123573 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.123663 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.124047 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.124147 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.124382 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.124654 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.124742 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.124982 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.125078 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.125287 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.125375 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.125611 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.125699 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.125921 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.126011 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.126254 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.126346 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.126568 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.126669 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.126877 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.126968 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.127186 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.127272 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.127490 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.127584 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.127798 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.127888 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.128105 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.128202 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.128412 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.128507 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.128719 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.128841 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.129027 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.129124 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.129332 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.129444 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.129640 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.129737 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.129960 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.130060 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.130324 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.130430 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.130630 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.130727 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.130947 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.131043 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.131256 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.131361 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.131571 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.131666 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.131881 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.131976 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.132189 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.132301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.132496 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.132636 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.132801 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.132939 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.133118 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.133363 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.133501 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.134039 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.134213 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.134398 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.134498 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.134736 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.134826 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.135067 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.135156 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.135375 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.135474 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.135681 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.135783 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.135986 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.136075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.136312 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.136402 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.136623 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.136711 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.136931 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.137025 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.137236 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.137326 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.137541 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.137630 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.137848 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.137938 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.138180 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.138275 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.138491 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.138591 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.138796 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.138946 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.139103 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.139193 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.139408 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.139517 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.139733 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.139831 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.140047 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.140170 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.140364 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.140484 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.140676 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.140803 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.140981 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.141148 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.141281 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.141470 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.141590 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.141788 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.141877 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.142102 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.142210 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.142443 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.142543 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.142755 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.142845 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.143065 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.143161 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.143362 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.143459 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.143665 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.143754 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.143967 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.144055 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.144266 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.144373 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.144566 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.144655 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.144866 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.144955 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.145173 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.145291 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.145474 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.145604 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.145774 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.145920 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.146073 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.146266 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.146397 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.146576 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.146699 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.146897 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.147029 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.147217 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.147362 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.147526 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.147677 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.147842 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.147998 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.148136 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.148311 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.148482 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.148618 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.148803 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.148928 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.149132 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.149250 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.149456 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.149571 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.149759 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.149888 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.150063 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.150219 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.150397 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.150555 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.150704 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.150866 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.151020 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.151178 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.151326 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.151489 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.151626 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.151800 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.151924 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.152110 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.152230 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.152418 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.152516 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.152743 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.152832 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.153068 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.153165 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.153374 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.153463 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.153722 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.153819 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.153971 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.154060 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.154301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.154392 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.154599 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.154689 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.154896 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.154995 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.155414 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.155685 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.156116 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.156208 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.156300 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.156397 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.156490 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.156573 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.156746 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.156836 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.157055 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.157155 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.157371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.157461 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.157680 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.157769 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.158003 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.158092 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.158355 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.158445 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.158665 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.158754 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.158985 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.159115 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.159296 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.159394 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.159615 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.159704 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.159921 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.160019 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.160242 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.160331 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.160560 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.160649 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.160872 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.160962 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.161178 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.161267 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.161481 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.161578 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.161725 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 12:53:30.161822 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.162095 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.162428 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.162734 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.163040 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.163344 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.163668 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.163988 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.164296 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.164616 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.164933 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.165249 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.165560 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.165866 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.166215 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.166524 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.166830 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.167140 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.167444 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.167949 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.168133 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.168350 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.168675 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.168996 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.169300 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.169623 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.169945 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.170309 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.170619 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.171018 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.171389 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.171654 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.171964 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.172263 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 12:53:30.172502 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 12:53:30.220288 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Registered counter for database nova_api Jun 03 12:53:30.230697 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO dbcounter [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] Registered counter for database nova_api Jun 03 12:53:30.241436 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 12:53:30.249272 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 12:53:30.250718 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG oslo_db.sqlalchemy.engines [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 12:53:30.258497 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writer thread running {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 12:53:30.306266 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.context [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),55a1a63d-d44c-44ec-ac39-183e23168b3e(cell1) {{(pid=103147) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 12:53:30.310392 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:53:30.312029 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:53:30.312811 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:53:30.314863 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:53:30.315741 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.context [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),55a1a63d-d44c-44ec-ac39-183e23168b3e(cell1) {{(pid=103146) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 12:53:30.316819 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Registered counter for database nova_cell0 Jun 03 12:53:30.319883 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG oslo_concurrency.lockutils [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:53:30.320885 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Registered counter for database nova_cell1 Jun 03 12:53:30.321483 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG oslo_concurrency.lockutils [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:53:30.322308 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG oslo_concurrency.lockutils [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 12:53:30.324267 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG oslo_concurrency.lockutils [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103146) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 12:53:30.326617 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO dbcounter [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] Registered counter for database nova_cell0 Jun 03 12:53:30.329797 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 12:53:30.330408 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 12:53:30.330939 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO dbcounter [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] Registered counter for database nova_cell1 Jun 03 12:53:30.334955 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 12:53:30.337873 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG oslo_db.sqlalchemy.engines [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 12:53:30.341688 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG oslo_db.sqlalchemy.engines [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 12:53:30.343340 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writer thread running {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 12:53:30.473934 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 12:53:30.484459 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Registered counter for database nova_cell0 Jun 03 12:53:30.487577 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writer thread running {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 12:53:30.493832 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 12:53:30.496805 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO dbcounter [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] Registered counter for database nova_cell0 Jun 03 12:53:30.498433 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 12:53:30.509196 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG oslo_db.sqlalchemy.engines [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 12:53:30.514836 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writer thread running {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 12:53:30.963587 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 12:53:30.971118 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 12:53:30.977033 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: WARNING keystonemiddleware.auth_token [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 12:53:30.984827 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: WARNING keystonemiddleware.auth_token [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 12:53:31.188816 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 12:53:31.194791 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 12:53:31.199933 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d88b2db9c0 pid: 103147 (default app) Jun 03 12:53:31.202414 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:53:31.203594 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002098 Jun 03 12:53:31.203996 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Fri Jun 3 12:53:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:53:31.211315 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: WARNING keystonemiddleware.auth_token [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 12:53:31.217398 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: WARNING keystonemiddleware.auth_token [None req-07fd3c22-f03e-4755-ba3d-eb315452909f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 12:53:31.223234 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d88b2db9c0 pid: 103146 (default app) Jun 03 12:54:50.977365 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:54:50.978469 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 03 12:54:50.979169 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:54:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 12:54:50.991284 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writing DB stats nova_api:SELECT=3 {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:50.992865 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writing DB stats nova_cell0:SELECT=3 {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:50.993924 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writing DB stats nova_cell1:SELECT=3 {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:50.994751 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:51.443362 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-71cdfec6-c7d2-4011-ae3f-66757fecf80e admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:54:51.472253 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-71cdfec6-c7d2-4011-ae3f-66757fecf80e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.486168 Jun 03 12:54:51.473073 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1291 bytes} [Fri Jun 3 12:54:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:54:53.760622 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:54:53.761621 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-a3de4a91-3f8f-4006-9e37-c0a57851d255 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 03 12:54:53.762277 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:54:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:54:53.825567 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-6f077d5d-afbc-429b-8aa9-307fc1dba10c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "disk": 1, "swap": 0, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:54:53.843774 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:54:53.843774 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: warnings.warn(msg) Jun 03 12:54:53.873331 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-6f077d5d-afbc-429b-8aa9-307fc1dba10c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105187 Jun 03 12:54:53.873866 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1282 bytes} [Fri Jun 3 12:54:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:54:53.887818 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=3 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:53.889071 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell1:SELECT=3 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:53.889797 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell0:SELECT=3 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:53.890524 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:54:54.091761 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-f501c53e-c9b8-4245-b695-f3b7a30d7b0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:54:54.094151 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:54:54.094151 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jun 03 12:54:54.156191 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-f501c53e-c9b8-4245-b695-f3b7a30d7b0c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.273544 Jun 03 12:54:54.166506 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1335 bytes} [Fri Jun 3 12:54:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:54:56.493270 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-6f077d5d-afbc-429b-8aa9-307fc1dba10c admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:54:56.494271 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-6f077d5d-afbc-429b-8aa9-307fc1dba10c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 03 12:54:56.494891 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:54:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:54:56.608161 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-ad007823-a40b-436c-8e1f-cb47618c6ebd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "ram": 512, "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:54:56.625962 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:54:56.625962 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jun 03 12:54:56.646647 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-ad007823-a40b-436c-8e1f-cb47618c6ebd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145175 Jun 03 12:54:56.647220 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1282 bytes} [Fri Jun 3 12:54:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:54:56.659170 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-617e4eb7-1ded-4f59-8572-c1d1dde2b7cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:54:56.660665 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 12:54:56.660665 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: warnings.warn(msg) Jun 03 12:54:56.701181 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-617e4eb7-1ded-4f59-8572-c1d1dde2b7cf admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045710 Jun 03 12:54:56.701968 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1335 bytes} [Fri Jun 3 12:54:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:54:59.007646 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-ad007823-a40b-436c-8e1f-cb47618c6ebd admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:54:59.009656 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-ad007823-a40b-436c-8e1f-cb47618c6ebd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002440 Jun 03 12:54:59.010712 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:54:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:54:59.071097 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-f350de3c-daa9-4b53-91c5-616f0e816557 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:54:59.095227 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-f350de3c-daa9-4b53-91c5-616f0e816557 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078900 Jun 03 12:54:59.102143 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1282 bytes} [Fri Jun 3 12:54:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 12:54:59.109579 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-ac385e4c-b1b6-4402-9296-1b3bc7b01a85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:54:59.142440 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-ac385e4c-b1b6-4402-9296-1b3bc7b01a85 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036984 Jun 03 12:54:59.143503 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1335 bytes} [Fri Jun 3 12:54:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:55:01.487417 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-f350de3c-daa9-4b53-91c5-616f0e816557 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:01.487417 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-f350de3c-daa9-4b53-91c5-616f0e816557 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 03 12:55:01.487417 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:55:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:01.550263 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-ac52e4cf-efcf-43b5-81b1-2765d0bcf515 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:01.571480 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-ac52e4cf-efcf-43b5-81b1-2765d0bcf515 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082631 Jun 03 12:55:01.572043 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1282 bytes} [Fri Jun 3 12:55:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:55:01.585483 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-4413b3d7-a298-4cb6-af3b-5dc59d1a3fbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:01.612543 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-4413b3d7-a298-4cb6-af3b-5dc59d1a3fbb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031775 Jun 03 12:55:01.613471 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1335 bytes} [Fri Jun 3 12:55:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:55:03.936339 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-ac52e4cf-efcf-43b5-81b1-2765d0bcf515 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:03.937686 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-ac52e4cf-efcf-43b5-81b1-2765d0bcf515 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001792 Jun 03 12:55:03.938463 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:55:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:03.997251 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c5fecd71-5897-4b45-a46c-a7d77558fbd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:04.019529 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c5fecd71-5897-4b45-a46c-a7d77558fbd8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074724 Jun 03 12:55:04.021898 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1282 bytes} [Fri Jun 3 12:55:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 12:55:04.032944 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-b997396f-1226-4e6d-ae09-39440713c099 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:04.059724 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-b997396f-1226-4e6d-ae09-39440713c099 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030437 Jun 03 12:55:04.060463 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1335 bytes} [Fri Jun 3 12:55:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:55:06.371296 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c5fecd71-5897-4b45-a46c-a7d77558fbd8 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:06.373449 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c5fecd71-5897-4b45-a46c-a7d77558fbd8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002906 Jun 03 12:55:06.374065 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:55:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:06.451181 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-8bb65664-c09f-4295-b6c1-81452840020d admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:06.478308 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-8bb65664-c09f-4295-b6c1-81452840020d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.097588 Jun 03 12:55:06.482346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1291 bytes} [Fri Jun 3 12:55:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:55:08.827130 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c5fecd71-5897-4b45-a46c-a7d77558fbd8 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:08.829132 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c5fecd71-5897-4b45-a46c-a7d77558fbd8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002925 Jun 03 12:55:08.830158 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:55:08 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:08.892719 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-f7878b8b-4fb6-46e7-9f06-0dfd687721ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "vcpus": 1, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:08.913433 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-f7878b8b-4fb6-46e7-9f06-0dfd687721ac admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075757 Jun 03 12:55:08.913996 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1282 bytes} [Fri Jun 3 12:55:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:55:08.926672 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-ffb11768-c538-4d03-b4c5-0e96027b3bca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:08.953988 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-ffb11768-c538-4d03-b4c5-0e96027b3bca admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031001 Jun 03 12:55:08.954670 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1332 bytes} [Fri Jun 3 12:55:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:55:11.242247 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-f7878b8b-4fb6-46e7-9f06-0dfd687721ac admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:11.243283 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-f7878b8b-4fb6-46e7-9f06-0dfd687721ac admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jun 03 12:55:11.243695 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:55:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:11.304724 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-a7b2f9d5-f8f5-483f-9ee6-7d0590cbc0af admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:11.328711 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-a7b2f9d5-f8f5-483f-9ee6-7d0590cbc0af admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078748 Jun 03 12:55:11.329753 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1282 bytes} [Fri Jun 3 12:55:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 12:55:11.342550 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-65018303-f63e-4ebd-b2f7-982fbceabf76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:11.367341 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-65018303-f63e-4ebd-b2f7-982fbceabf76 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028500 Jun 03 12:55:11.367832 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1332 bytes} [Fri Jun 3 12:55:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:55:13.703924 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-a7b2f9d5-f8f5-483f-9ee6-7d0590cbc0af admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:13.705605 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-a7b2f9d5-f8f5-483f-9ee6-7d0590cbc0af admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002489 Jun 03 12:55:13.706330 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:55:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:13.786557 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-14569c0b-1e60-4c0b-be1f-2e3d37ca929e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "id": "3"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:13.810945 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-14569c0b-1e60-4c0b-be1f-2e3d37ca929e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.096100 Jun 03 12:55:13.811602 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1282 bytes} [Fri Jun 3 12:55:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 12:55:13.829374 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-dbb2c91f-5bd4-448c-a999-fee5eb43419b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:13.863273 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-dbb2c91f-5bd4-448c-a999-fee5eb43419b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040555 Jun 03 12:55:13.864472 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1332 bytes} [Fri Jun 3 12:55:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:55:16.259590 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-14569c0b-1e60-4c0b-be1f-2e3d37ca929e admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:16.260656 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-14569c0b-1e60-4c0b-be1f-2e3d37ca929e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jun 03 12:55:16.261016 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:55:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:16.324702 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-68a5c7d7-8590-40f5-8194-a2ebe73bdff3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "rxtx_factor": 1.0, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "m1.large"}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:16.344582 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-68a5c7d7-8590-40f5-8194-a2ebe73bdff3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077181 Jun 03 12:55:16.345155 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1282 bytes} [Fri Jun 3 12:55:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 12:55:16.357934 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-428841cf-a981-43c3-aa3f-33ad7c59aeca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:16.383542 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-428841cf-a981-43c3-aa3f-33ad7c59aeca admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029262 Jun 03 12:55:16.384236 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1332 bytes} [Fri Jun 3 12:55:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:55:18.701791 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-68a5c7d7-8590-40f5-8194-a2ebe73bdff3 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:18.702845 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-68a5c7d7-8590-40f5-8194-a2ebe73bdff3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 03 12:55:18.703246 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:55:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:18.761119 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-fd81dd43-4838-44b6-916b-db0b2e25d994 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 16384}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:18.781189 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-fd81dd43-4838-44b6-916b-db0b2e25d994 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071719 Jun 03 12:55:18.781737 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1282 bytes} [Fri Jun 3 12:55:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 12:55:18.793897 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-e7673b33-8e3c-4365-863c-9799066986cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:18.818804 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-e7673b33-8e3c-4365-863c-9799066986cb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028822 Jun 03 12:55:18.819486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1332 bytes} [Fri Jun 3 12:55:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 12:55:45.985194 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-fd81dd43-4838-44b6-916b-db0b2e25d994 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:45.986276 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-fd81dd43-4838-44b6-916b-db0b2e25d994 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 03 12:55:45.986649 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:55:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:46.003330 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:55:46.052943 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-a9010745-bcac-4d62-a2ce-facfd695c790 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:46.069952 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-a9010745-bcac-4d62-a2ce-facfd695c790 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074042 Jun 03 12:55:46.070516 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1291 bytes} [Fri Jun 3 12:55:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:55:47.087127 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-fd81dd43-4838-44b6-916b-db0b2e25d994 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:47.088515 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-fd81dd43-4838-44b6-916b-db0b2e25d994 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 Jun 03 12:55:47.089060 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Jun 3 12:55:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:47.310790 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-d53553ae-f83a-4088-be48-e0ac4cc2b6bf admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:47.316630 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.wsgi [None req-d53553ae-f83a-4088-be48-e0ac4cc2b6bf admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-d53553ae-f83a-4088-be48-e0ac4cc2b6bf admin admin] Request method failure captured: Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Accept: application/json Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Accept-Encoding: gzip, deflate Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Connection: keep-alive Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Content-Length: 0 Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Host: 10.222.0.58 Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Openstack-Api-Version: compute 2.90 Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Openstack-System-Scope: None Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: User-Agent: python-novaclient Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Auth-Token: gAAAAABimgTTuSBil58m-HZ9MnmhAzBVLp8LABdOZAAMcVBpyen9NuowkDLrQ38N6F5--v3ZVP1KBLPaM_kuqR9OhxzekdpMFhgogBivn33XgKPNeFLb3MtaSE0gC3XpO9qtYQSjUDjJOwYWlPFxOZjrDVPwxMNiN6HDQ58eHrSy-7qHbitC68Q Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Domain-Id: None Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Domain-Name: None Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Identity-Status: Confirmed Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Is-Admin-Project: True Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Project-Domain-Id: default Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Project-Domain-Name: Default Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Project-Id: 8cee784ec8864757a1c8441df24c7f48 Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Project-Name: admin Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Role: member,reader,admin Jun 03 12:55:47.319946 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Roles: member,reader,admin Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8cee784ec8864757a1c8441df24c7f48"}]}] Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Tenant: admin Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Tenant-Id: 8cee784ec8864757a1c8441df24c7f48 Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Tenant-Name: admin Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User: admin Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User-Domain-Id: default Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User-Domain-Name: Default Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User-Id: 0996f80baf904a69852b0b6c8fb6bc6f Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User-Name: admin Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: method: > Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: exception: Flavor 42 could not be found. Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: action_args: {'id': '42'} Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:55:47.321405 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:55:47.322355 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:47.323531 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-d53553ae-f83a-4088-be48-e0ac4cc2b6bf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:55:47.324590 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-d53553ae-f83a-4088-be48-e0ac4cc2b6bf admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.072433 Jun 03 12:55:47.324590 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Fri Jun 3 12:55:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:47.332853 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-a62e8721-819a-438e-80e9-6651f49ca20a admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:47.335882 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:55:47.355504 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-a62e8721-819a-438e-80e9-6651f49ca20a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027387 Jun 03 12:55:47.356057 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Fri Jun 3 12:55:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:55:47.366223 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-6f5f6513-f404-43be-b5b2-550199f5bed6 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:47.388237 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-6f5f6513-f404-43be-b5b2-550199f5bed6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025679 Jun 03 12:55:47.388883 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Fri Jun 3 12:55:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:55:47.402158 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-ee8fd0ab-d232-470c-87d0-2ee17646f47f admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:47.410992 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.wsgi [None req-ee8fd0ab-d232-470c-87d0-2ee17646f47f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-ee8fd0ab-d232-470c-87d0-2ee17646f47f admin admin] Request method failure captured: Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Accept: application/json Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Accept-Encoding: gzip, deflate Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Connection: keep-alive Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Content-Length: 0 Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Host: 10.222.0.58 Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Openstack-Api-Version: compute 2.90 Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Openstack-System-Scope: None Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: User-Agent: python-novaclient Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Auth-Token: gAAAAABimgTTuSBil58m-HZ9MnmhAzBVLp8LABdOZAAMcVBpyen9NuowkDLrQ38N6F5--v3ZVP1KBLPaM_kuqR9OhxzekdpMFhgogBivn33XgKPNeFLb3MtaSE0gC3XpO9qtYQSjUDjJOwYWlPFxOZjrDVPwxMNiN6HDQ58eHrSy-7qHbitC68Q Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Domain-Id: None Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Domain-Name: None Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Identity-Status: Confirmed Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Is-Admin-Project: True Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Project-Domain-Id: default Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Project-Domain-Name: Default Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Project-Id: 8cee784ec8864757a1c8441df24c7f48 Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Project-Name: admin Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Role: member,reader,admin Jun 03 12:55:47.414346 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Roles: member,reader,admin Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8cee784ec8864757a1c8441df24c7f48"}]}] Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Tenant: admin Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Tenant-Id: 8cee784ec8864757a1c8441df24c7f48 Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Tenant-Name: admin Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User: admin Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User-Domain-Id: default Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User-Domain-Name: Default Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User-Id: 0996f80baf904a69852b0b6c8fb6bc6f Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User-Name: admin Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: method: > Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: exception: Flavor 42 could not be found. Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: action_args: {'id': '42'} Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:55:47.415840 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:55:47.416777 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:47.418259 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-ee8fd0ab-d232-470c-87d0-2ee17646f47f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:55:47.420081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-ee8fd0ab-d232-470c-87d0-2ee17646f47f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018941 Jun 03 12:55:47.420081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Fri Jun 3 12:55:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:48.311124 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-6f5f6513-f404-43be-b5b2-550199f5bed6 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:48.312456 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-6f5f6513-f404-43be-b5b2-550199f5bed6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 Jun 03 12:55:48.312960 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Jun 3 12:55:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:48.513725 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-f8bb6f9d-504b-4f39-b151-08c4d908779b admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:48.520145 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.wsgi [None req-f8bb6f9d-504b-4f39-b151-08c4d908779b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-f8bb6f9d-504b-4f39-b151-08c4d908779b admin admin] Request method failure captured: Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Accept: application/json Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Accept-Encoding: gzip, deflate Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Connection: keep-alive Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Content-Length: 0 Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Host: 10.222.0.58 Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Openstack-Api-Version: compute 2.90 Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Openstack-System-Scope: None Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: User-Agent: python-novaclient Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Auth-Token: gAAAAABimgTUiqt_r37zySo0N0f2_PHh2CM52wskdKXWQXnxFE6n0Z_xOULxPQGyQsFqjTmxt_yyS2LL20axf7-BHprbnuJeZZ4JEJw6mHTyf9dQnJWjvtDKaweYJOZzp1jueOcn2dkkkp9zw1vVNrY4D1z4sOa1DgAMYdgCyBCa0RMI_Nb0G2I Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Domain-Id: None Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Domain-Name: None Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Identity-Status: Confirmed Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Is-Admin-Project: True Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Project-Domain-Id: default Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Project-Domain-Name: Default Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Project-Id: 8cee784ec8864757a1c8441df24c7f48 Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Project-Name: admin Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Role: member,reader,admin Jun 03 12:55:48.521680 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Roles: member,reader,admin Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8cee784ec8864757a1c8441df24c7f48"}]}] Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Tenant: admin Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Tenant-Id: 8cee784ec8864757a1c8441df24c7f48 Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Tenant-Name: admin Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User: admin Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User-Domain-Id: default Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User-Domain-Name: Default Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User-Id: 0996f80baf904a69852b0b6c8fb6bc6f Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User-Name: admin Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: method: > Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: exception: Flavor 84 could not be found. Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: action_args: {'id': '84'} Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:55:48.523371 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:55:48.524348 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:48.525692 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-f8bb6f9d-504b-4f39-b151-08c4d908779b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:55:48.527023 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-f8bb6f9d-504b-4f39-b151-08c4d908779b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.075172 Jun 03 12:55:48.527023 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Fri Jun 3 12:55:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:48.533751 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-736eef11-082e-4ab3-ba48-702f049174bc admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:48.547890 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-736eef11-082e-4ab3-ba48-702f049174bc admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018009 Jun 03 12:55:48.548487 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Fri Jun 3 12:55:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:55:48.558684 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-2c3c0d72-0b78-4d7c-860c-9e75724e9eab admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:48.572748 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-2c3c0d72-0b78-4d7c-860c-9e75724e9eab admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017732 Jun 03 12:55:48.573275 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Fri Jun 3 12:55:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:55:48.582605 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-68718666-6338-44b6-aa76-d05464483f60 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:48.588190 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.wsgi [None req-68718666-6338-44b6-aa76-d05464483f60 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-68718666-6338-44b6-aa76-d05464483f60 admin admin] Request method failure captured: Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Accept: application/json Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Accept-Encoding: gzip, deflate Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Connection: keep-alive Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Content-Length: 0 Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Host: 10.222.0.58 Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Openstack-Api-Version: compute 2.90 Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Openstack-System-Scope: None Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: User-Agent: python-novaclient Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Auth-Token: gAAAAABimgTUiqt_r37zySo0N0f2_PHh2CM52wskdKXWQXnxFE6n0Z_xOULxPQGyQsFqjTmxt_yyS2LL20axf7-BHprbnuJeZZ4JEJw6mHTyf9dQnJWjvtDKaweYJOZzp1jueOcn2dkkkp9zw1vVNrY4D1z4sOa1DgAMYdgCyBCa0RMI_Nb0G2I Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Domain-Id: None Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Domain-Name: None Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Identity-Status: Confirmed Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Is-Admin-Project: True Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Project-Domain-Id: default Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Project-Domain-Name: Default Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Project-Id: 8cee784ec8864757a1c8441df24c7f48 Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Project-Name: admin Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Role: member,reader,admin Jun 03 12:55:48.589713 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Roles: member,reader,admin Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8cee784ec8864757a1c8441df24c7f48"}]}] Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Tenant: admin Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Tenant-Id: 8cee784ec8864757a1c8441df24c7f48 Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Tenant-Name: admin Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User: admin Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User-Domain-Id: default Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User-Domain-Name: Default Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User-Id: 0996f80baf904a69852b0b6c8fb6bc6f Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User-Name: admin Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: method: > Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: exception: Flavor 84 could not be found. Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: action_args: {'id': '84'} Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:55:48.591301 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:55:48.592261 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:48.593559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-68718666-6338-44b6-aa76-d05464483f60 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:55:48.594849 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-68718666-6338-44b6-aa76-d05464483f60 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012114 Jun 03 12:55:48.594849 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Fri Jun 3 12:55:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:49.475905 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-2c3c0d72-0b78-4d7c-860c-9e75724e9eab admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:49.476926 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-2c3c0d72-0b78-4d7c-860c-9e75724e9eab admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 03 12:55:49.477324 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Jun 3 12:55:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:49.682383 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-ac0ff4c2-e2b2-466e-a1b0-efb9bf31f1fc admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:49.688303 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.wsgi [None req-ac0ff4c2-e2b2-466e-a1b0-efb9bf31f1fc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-ac0ff4c2-e2b2-466e-a1b0-efb9bf31f1fc admin admin] Request method failure captured: Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Accept: application/json Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Accept-Encoding: gzip, deflate Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Connection: keep-alive Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Content-Length: 0 Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Host: 10.222.0.58 Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Openstack-Api-Version: compute 2.90 Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Openstack-System-Scope: None Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: User-Agent: python-novaclient Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Auth-Token: gAAAAABimgTVuZx7c3qHJcqfv9tnL0U-X0tBYDSpCcYW_blS7VUjB9a4fhK4gwx9NPn_OSTQjIf8f5CXGT7gvDC8t6h14yJIB1cfGT7nob8pu1dgtzgBmch8OCHDr8FJIwqVaBtvip4fCMKqj-imAkKO32gDusB5RNxJGnVjQcVnx7QVxvXEg4I Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Domain-Id: None Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Domain-Name: None Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Identity-Status: Confirmed Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Is-Admin-Project: True Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Project-Domain-Id: default Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Project-Domain-Name: Default Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Project-Id: 8cee784ec8864757a1c8441df24c7f48 Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Project-Name: admin Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Role: member,reader,admin Jun 03 12:55:49.689809 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Roles: member,reader,admin Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8cee784ec8864757a1c8441df24c7f48"}]}] Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Tenant: admin Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Tenant-Id: 8cee784ec8864757a1c8441df24c7f48 Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-Tenant-Name: admin Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User: admin Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User-Domain-Id: default Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User-Domain-Name: Default Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User-Id: 0996f80baf904a69852b0b6c8fb6bc6f Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: X-User-Name: admin Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: method: > Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: exception: Flavor 451 could not be found. Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: action_args: {'id': '451'} Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:55:49.691554 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:55:49.692710 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: ERROR nova.api.openstack.wsgi Jun 03 12:55:49.694486 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-ac0ff4c2-e2b2-466e-a1b0-efb9bf31f1fc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103146) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:55:49.696200 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-ac0ff4c2-e2b2-466e-a1b0-efb9bf31f1fc admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.077096 Jun 03 12:55:49.696200 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Fri Jun 3 12:55:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:49.706362 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-01325dd8-415d-45fb-9234-d5f6d33d79ca admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:49.720284 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-01325dd8-415d-45fb-9234-d5f6d33d79ca admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019691 Jun 03 12:55:49.720835 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Fri Jun 3 12:55:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:55:49.733032 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:49.754044 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026410 Jun 03 12:55:49.754619 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Fri Jun 3 12:55:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:55:49.764171 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-2f063d91-ecc1-424f-a558-7a5559aec156 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:49.769891 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.wsgi [None req-2f063d91-ecc1-424f-a558-7a5559aec156 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-2f063d91-ecc1-424f-a558-7a5559aec156 admin admin] Request method failure captured: Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Accept: application/json Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Accept-Encoding: gzip, deflate Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Connection: keep-alive Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Content-Length: 0 Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Host: 10.222.0.58 Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Openstack-Api-Version: compute 2.90 Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Openstack-System-Scope: None Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: User-Agent: python-novaclient Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Auth-Token: gAAAAABimgTVuZx7c3qHJcqfv9tnL0U-X0tBYDSpCcYW_blS7VUjB9a4fhK4gwx9NPn_OSTQjIf8f5CXGT7gvDC8t6h14yJIB1cfGT7nob8pu1dgtzgBmch8OCHDr8FJIwqVaBtvip4fCMKqj-imAkKO32gDusB5RNxJGnVjQcVnx7QVxvXEg4I Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Domain-Id: None Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Domain-Name: None Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Identity-Status: Confirmed Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Is-Admin-Project: True Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Project-Domain-Id: default Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Project-Domain-Name: Default Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Project-Id: 8cee784ec8864757a1c8441df24c7f48 Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Project-Name: admin Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Role: member,reader,admin Jun 03 12:55:49.771443 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Roles: member,reader,admin Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8cee784ec8864757a1c8441df24c7f48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8cee784ec8864757a1c8441df24c7f48"}]}] Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Tenant: admin Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Tenant-Id: 8cee784ec8864757a1c8441df24c7f48 Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-Tenant-Name: admin Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User: admin Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User-Domain-Id: default Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User-Domain-Name: Default Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User-Id: 0996f80baf904a69852b0b6c8fb6bc6f Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: X-User-Name: admin Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: method: > Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: exception: Flavor 451 could not be found. Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: action_args: {'id': '451'} Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 12:55:49.773081 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:55:49.773948 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Jun 03 12:55:49.775075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-2f063d91-ecc1-424f-a558-7a5559aec156 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 12:55:49.776196 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-2f063d91-ecc1-424f-a558-7a5559aec156 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012240 Jun 03 12:55:49.776196 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Fri Jun 3 12:55:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 12:55:50.718826 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:50.719871 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jun 03 12:55:50.720289 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Jun 3 12:55:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:50.931125 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-027366f1-d256-4a6a-9c15-7308e07d4176 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:50.952791 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-027366f1-d256-4a6a-9c15-7308e07d4176 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.094182 Jun 03 12:55:50.953344 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Fri Jun 3 12:55:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:55:51.857600 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:51.858647 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 03 12:55:51.859042 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Jun 3 12:55:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:52.053210 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-ab72ac56-d87b-492c-aa40-3a1d54e6c44e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:52.073264 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-ab72ac56-d87b-492c-aa40-3a1d54e6c44e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.075123 Jun 03 12:55:52.073787 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Fri Jun 3 12:55:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:55:52.983718 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:52.985085 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Jun 03 12:55:52.985559 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Jun 3 12:55:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:53.191706 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-dc3fd58b-675e-4b4f-9608-839ea409bf56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:53.212220 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-dc3fd58b-675e-4b4f-9608-839ea409bf56 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.079308 Jun 03 12:55:53.212805 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Fri Jun 3 12:55:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:55:54.090480 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:54.091493 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 03 12:55:54.092162 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Jun 3 12:55:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:54.288412 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d40223cc-981d-4b05-b6cd-95b3f319cbb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 12:55:54.314418 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-d40223cc-981d-4b05-b6cd-95b3f319cbb7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.081836 Jun 03 12:55:54.315204 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Fri Jun 3 12:55:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 12:55:55.191630 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:55.192692 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 03 12:55:55.193081 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Jun 3 12:55:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:55:55.385328 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-648db668-135b-4685-b650-0282c7828352 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:55:55.405008 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-648db668-135b-4685-b650-0282c7828352 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074208 Jun 03 12:55:55.405470 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Fri Jun 3 12:55:55 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:56:56.890477 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:56:56.891537 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-c4826f24-b8e5-4a2d-a542-e7d671aa4676 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 03 12:56:56.891931 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 930 bytes} [Fri Jun 3 12:56:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 12:56:56.901168 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:56:56.967112 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-84938285-3e8e-4915-b5ea-4e08f4e0d8cd admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:56:56.987184 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-84938285-3e8e-4915-b5ea-4e08f4e0d8cd admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.088641 Jun 03 12:56:56.987720 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1291 bytes} [Fri Jun 3 12:56:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 12:56:57.018566 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG dbcounter [-] [103146] Writing DB stats nova_api:SELECT=14 {{(pid=103146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 12:56:57.022520 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-5ce2ef46-777f-4462-9c93-1bc4d4c41270 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:56:57.030890 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-5ce2ef46-777f-4462-9c93-1bc4d4c41270 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013813 Jun 03 12:56:57.031427 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1282 bytes} [Fri Jun 3 12:56:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:56:57.042988 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-586924cd-f4bb-403c-830c-bbf478e12700 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:56:57.051408 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-586924cd-f4bb-403c-830c-bbf478e12700 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012012 Jun 03 12:56:57.051924 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1285 bytes} [Fri Jun 3 12:56:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:56:57.063228 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-321ec7c4-c889-4823-9bfc-4f54ecd3c859 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:56:57.070972 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-321ec7c4-c889-4823-9bfc-4f54ecd3c859 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011217 Jun 03 12:56:57.071418 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1285 bytes} [Fri Jun 3 12:56:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 12:56:57.083008 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-644d6e66-2bc8-4f0c-b995-fa08fe252da4 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 12:56:57.091271 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-644d6e66-2bc8-4f0c-b995-fa08fe252da4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011802 Jun 03 12:56:57.091830 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1282 bytes} [Fri Jun 3 12:56:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:00:13.965681 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-321ec7c4-c889-4823-9bfc-4f54ecd3c859 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:00:13.966750 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-321ec7c4-c889-4823-9bfc-4f54ecd3c859 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 03 13:00:13.967152 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Jun 3 13:00:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:00:14.125267 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=6 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:00:14.255858 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-54b152b2-4069-4ce1-8f31-fdb64c91e795 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:00:14.257650 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:00:14.257650 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jun 03 13:00:14.259474 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-54b152b2-4069-4ce1-8f31-fdb64c91e795 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:00:14.260075 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-54b152b2-4069-4ce1-8f31-fdb64c91e795 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:00:14.261304 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-54b152b2-4069-4ce1-8f31-fdb64c91e795 admin admin] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:00:14.261836 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-54b152b2-4069-4ce1-8f31-fdb64c91e795 admin admin] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:00:14.298587 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-54b152b2-4069-4ce1-8f31-fdb64c91e795 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.174778 Jun 03 13:00:14.299162 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Fri Jun 3 13:00:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:00:15.171239 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-321ec7c4-c889-4823-9bfc-4f54ecd3c859 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:00:15.172910 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-321ec7c4-c889-4823-9bfc-4f54ecd3c859 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002403 Jun 03 13:00:15.173521 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Jun 3 13:00:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:00:15.382857 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-9454d34d-61f5-497b-81da-add24d5755d0 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:00:15.384019 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:00:15.384019 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jun 03 13:00:15.385214 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-9454d34d-61f5-497b-81da-add24d5755d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:00:15.385651 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-9454d34d-61f5-497b-81da-add24d5755d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:00:15.386497 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-9454d34d-61f5-497b-81da-add24d5755d0 admin admin] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:00:15.386914 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-9454d34d-61f5-497b-81da-add24d5755d0 admin admin] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:00:15.406232 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-9454d34d-61f5-497b-81da-add24d5755d0 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079854 Jun 03 13:00:15.406823 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Fri Jun 3 13:00:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:00:26.726288 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-321ec7c4-c889-4823-9bfc-4f54ecd3c859 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:00:26.727309 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-321ec7c4-c889-4823-9bfc-4f54ecd3c859 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jun 03 13:00:26.727747 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Jun 3 13:00:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:00:26.870229 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell0:SELECT=4 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:00:26.870965 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell1:SELECT=4 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:00:26.871557 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=8 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:00:26.924092 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d19e42c3-28bd-4c70-87f8-37788380c88d admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:00:26.925266 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:00:26.925266 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jun 03 13:00:26.926476 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-d19e42c3-28bd-4c70-87f8-37788380c88d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:00:26.926916 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-d19e42c3-28bd-4c70-87f8-37788380c88d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:00:26.927677 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-d19e42c3-28bd-4c70-87f8-37788380c88d admin admin] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:00:26.928096 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-d19e42c3-28bd-4c70-87f8-37788380c88d admin admin] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:00:26.952867 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-d19e42c3-28bd-4c70-87f8-37788380c88d admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088797 Jun 03 13:00:26.953332 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1193 bytes} [Fri Jun 3 13:00:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:00:27.825475 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: DEBUG nova.api.openstack.wsgi [None req-321ec7c4-c889-4823-9bfc-4f54ecd3c859 admin admin] Calling method '>' {{(pid=103146) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:00:27.826644 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: INFO nova.api.openstack.requestlog [None req-321ec7c4-c889-4823-9bfc-4f54ecd3c859 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Jun 03 13:00:27.827043 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: [pid: 103146|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1074 bytes} [Fri Jun 3 13:00:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:00:28.024286 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-7ebdd1ab-0e71-4793-9901-3067c96c49a9 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:00:28.025472 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 13:00:28.025472 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Jun 03 13:00:28.026702 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-7ebdd1ab-0e71-4793-9901-3067c96c49a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:00:28.027188 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-7ebdd1ab-0e71-4793-9901-3067c96c49a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:00:28.027966 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-7ebdd1ab-0e71-4793-9901-3067c96c49a9 admin admin] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:00:28.028389 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-7ebdd1ab-0e71-4793-9901-3067c96c49a9 admin admin] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:00:28.050445 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-7ebdd1ab-0e71-4793-9901-3067c96c49a9 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086124 Jun 03 13:00:28.050918 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1193 bytes} [Fri Jun 3 13:00:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:01:25.513593 dv-cinder-779540-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 03 13:01:25.514445 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: Fri Jun 3 13:01:25 2022 - graceful shutdown triggered... Jun 03 13:01:25.514919 dv-cinder-779540-3-iscsi devstack@n-api.service[103147]: Gracefully killing worker 2 (pid: 103147)... Jun 03 13:01:25.515298 dv-cinder-779540-3-iscsi devstack@n-api.service[103146]: Gracefully killing worker 1 (pid: 103146)... Jun 03 13:01:26.514551 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: worker 1 buried after 1 seconds Jun 03 13:01:26.514551 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: worker 2 buried after 1 seconds Jun 03 13:01:26.514551 dv-cinder-779540-3-iscsi devstack@n-api.service[103145]: goodbye to uWSGI. Jun 03 13:01:26.517008 dv-cinder-779540-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 03 13:01:26.518012 dv-cinder-779540-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 03 13:01:26.522337 dv-cinder-779540-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 13:01:26.544606 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 13:01:26.557649 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 13:01:26 2022] *** Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: nodename: dv-cinder-779540-3-iscsi Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: machine: x86_64 Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: clock source: unix Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: pcre jit disabled Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: detected number of CPU cores: 4 Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: current working directory: / Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: detected binary path: /usr/bin/uwsgi-core Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: your processes number limit is 47680 Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: your memory page size is 4096 bytes Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: detected max file descriptor number: 2048 Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: lock engine: pthread robust mutexes Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: thunder lock: enabled Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 13:01:26.561841 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 13:01:26.608051 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: Python main interpreter initialized at 0x55c7122f79c0 Jun 03 13:01:26.608051 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: python threads support enabled Jun 03 13:01:26.608051 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: your server socket listen backlog is limited to 100 connections Jun 03 13:01:26.608051 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: your mercy for graceful operations on workers is 90 seconds Jun 03 13:01:26.608480 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 13:01:26.608480 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: *** Operational MODE: preforking *** Jun 03 13:01:26.608734 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: *** uWSGI is running in multiple interpreter mode *** Jun 03 13:01:26.608734 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: spawned uWSGI master process (pid: 117713) Jun 03 13:01:26.608984 dv-cinder-779540-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 13:01:26.609986 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: spawned uWSGI worker 1 (pid: 117726, cores: 1) Jun 03 13:01:26.610528 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: spawned uWSGI worker 2 (pid: 117727, cores: 1) Jun 03 13:01:26.610824 dv-cinder-779540-3-iscsi devstack@n-api.service[117713]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 13:01:27.827130 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 13:01:27.829066 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 13:01:28.649798 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:01:28.649798 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: from cryptography.utils import int_from_bytes Jun 03 13:01:28.650349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:01:28.650349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: from cryptography.utils import int_from_bytes Jun 03 13:01:28.650501 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:01:28.650501 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: from cryptography.utils import int_from_bytes Jun 03 13:01:28.650645 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 13:01:28.650645 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: from cryptography.utils import int_from_bytes Jun 03 13:01:30.990159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 13:01:30.990766 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 13:01:30.991059 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 13:01:30.991276 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 13:01:30.991540 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 13:01:30.991935 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.992299 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.992598 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.992918 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.993285 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.993596 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.993922 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.994283 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.994620 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.994888 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.995175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.995511 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779540-3-iscsi {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.995836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.996148 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.996463 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.996818 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.997097 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.997426 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.997769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.998274 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.999789 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.999789 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:30.999789 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.000097 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.000319 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.000603 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.000930 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.001241 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.001662 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.002009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.002380 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779540-3-iscsi {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.002829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.003138 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.003467 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.003904 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.004224 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.004430 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 13:01:31.004865 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.004959 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 13:01:31.005041 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.005248 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.005368 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 13:01:31.005453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.005664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 13:01:31.005791 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.005896 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 13:01:31.006169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.006294 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.006516 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.006726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.006980 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.007190 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.007417 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.007630 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.007806 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.007996 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.008175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.008327 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.008478 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.008702 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.008847 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.009016 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.009160 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.009340 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.009493 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.009635 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.009793 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.009943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.010101 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.010270 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779540-3-iscsi {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.010412 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.010554 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.010857 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.011049 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.011202 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.011429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.011585 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.011740 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.011899 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.012042 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.012191 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.012347 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.012524 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.012705 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.012864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.012864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.013154 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.013325 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.013469 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.013652 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.013805 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.013948 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.014089 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.014276 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.014430 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.014584 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.014745 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.014896 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.015046 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.015197 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.015349 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.015494 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.016647 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.016812 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.016965 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.017116 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.017270 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.017421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.017572 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779540-3-iscsi {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.017729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.017881 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.018037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.018225 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.018383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.018538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.018692 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.018692 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.018988 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.019140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.019289 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.019439 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.019590 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.019744 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.019894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.020057 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.020201 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.020349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.020499 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.020651 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.020801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.020972 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.021257 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.021428 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.021574 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.021742 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.021896 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.022251 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.022416 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.022669 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.022830 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.022989 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.023141 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.023284 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.023433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.023583 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.023739 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.023884 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.024037 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.024188 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.024347 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.024490 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.024654 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.024844 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.024988 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.025198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.025352 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.025502 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.025659 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.025833 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.026967 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.027123 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.027278 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.027439 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.027594 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.027745 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.027890 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.028035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.028186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.028338 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.028490 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.028680 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.028842 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.028993 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.029145 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.029298 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.029441 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.029582 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.029731 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.029889 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.030045 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.030222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.030378 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.030531 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.030683 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.030845 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.030996 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.031141 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.031282 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.031438 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.031590 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.031740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.031891 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.032041 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.032192 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.032348 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.032633 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.032847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.033024 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.033177 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.033332 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.033476 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.033625 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.033768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.033920 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.034071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.034305 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.034451 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.034601 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.034752 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.034906 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.035063 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.035218 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.035374 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.035525 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.035678 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.035821 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.035971 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.036131 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.036787 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.036787 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.037373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.037538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.037696 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.037839 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.037980 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.038151 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.038348 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.038503 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.038656 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.038801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.038951 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.039093 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.039235 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.039376 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.039543 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.039695 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.039858 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.040012 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.040012 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.040293 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.040437 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.040585 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.040735 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.040928 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.041073 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.041302 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.041460 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.041629 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.041779 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.041922 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.042064 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.042265 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.042418 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.042569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.042723 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.042866 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.043028 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.043179 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.043330 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.043492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.043636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.043779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.043938 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.044080 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.044222 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.044376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.044526 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.044709 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.044864 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.045016 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.045159 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.045318 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.045478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.045629 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.045781 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.045924 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.046072 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.046295 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.046801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.047029 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.047429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.047429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.047710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.047861 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.048006 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.048160 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.048302 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.048450 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.048609 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.048753 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.048901 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.049057 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.049208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.049350 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.049501 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.049651 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.049806 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.049960 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.050163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.050313 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.050469 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.050620 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.050763 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.050916 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.051066 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.051217 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.051369 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.051522 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.051675 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.051819 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.051968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.052131 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.052281 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.052434 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.052578 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.052728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.052871 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.053020 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 13:01:31.053171 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.053323 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.053465 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.053615 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.053757 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.053909 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.054061 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.054246 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.054404 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.054692 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.054851 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.055003 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.055156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.055309 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.055453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.055603 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.055795 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.055956 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.056125 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.056276 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.056427 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.056786 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.057041 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.057150 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.057640 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.057735 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.057827 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.057917 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.057993 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.058075 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.058223 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.058308 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.058390 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.058464 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.058543 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.058630 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.058712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.058786 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.058866 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.058946 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059020 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059105 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059179 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059252 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059403 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059484 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059558 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059724 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059889 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.059971 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060052 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060133 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060133 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060133 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060133 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060133 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060473 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060553 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060649 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060728 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060800 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060886 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.060968 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061041 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061113 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061193 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061278 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061352 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061424 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061495 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061573 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061646 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061725 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061798 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061871 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.061942 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.062012 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.062090 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.062403 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.062489 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.062563 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.062641 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.062722 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.062794 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.062875 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.062956 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.063039 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.063113 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.063192 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.063348 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.063432 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.063506 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.063739 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.063832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.064100 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.064192 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.064412 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.064502 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.064758 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.064855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.065025 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.065123 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.065333 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.065415 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.065639 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.065723 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.065952 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.066047 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.066286 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.066376 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.066593 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.066713 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.066963 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.067077 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.067177 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.067264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.067739 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.067856 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.067956 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.068045 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.068163 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.068257 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.068477 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.068579 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.068794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.068898 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.069105 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.069206 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.069418 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.069535 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.069825 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.069939 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.070028 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.070152 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.070380 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.070482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.070691 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.070792 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.071000 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.071101 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.071322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.071423 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.071631 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.071730 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.071943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.072044 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.072252 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.072352 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.072564 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.072670 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.072883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.072982 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.073198 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.073305 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.073505 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.073596 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.073828 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.073929 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.074161 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.074271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.074480 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.074572 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.074860 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.074964 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.075145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.075248 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.075457 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.075548 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.075776 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.075869 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.076116 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.076273 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.076412 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.076501 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.076720 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.076808 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.077059 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.077145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.077310 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.077394 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.077618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.077964 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.078062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.078198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.078289 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.078366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.078538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.078631 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.078846 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.078928 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.079153 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.079242 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.079461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.079552 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.079801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.079913 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.080119 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.080204 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.080429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.080520 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.080734 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.080823 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.081039 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.081122 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.081345 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.081450 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.081673 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.081762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.081986 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.082075 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.082628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.082777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.082925 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.083065 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.083212 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.083360 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.083509 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.083648 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.083785 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.083940 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.084078 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.084227 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.084372 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.084510 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.084648 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.084788 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.084938 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.085143 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.085297 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.085443 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.085590 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.085730 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.085886 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.086272 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.086427 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.086566 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.086723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.086861 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.086997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.087295 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.087445 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.087607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.087814 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.088111 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.088250 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.088510 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.088650 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.088797 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.088942 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.089085 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.089222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.089372 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.089517 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.089654 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.089800 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.089949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.090086 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.090310 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.090450 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.090588 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.090730 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.090868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.091014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.091233 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.091394 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.091531 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.091676 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.091820 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.091972 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.092110 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.092263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.092401 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.092538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.092690 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.092915 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.093004 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.093078 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.093151 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.093230 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.093311 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.093392 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.093466 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.093542 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.093614 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.093685 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.093765 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.093839 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.094069 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.094190 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.094429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.094520 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.094742 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.094825 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.095053 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.095156 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.095440 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.095583 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.095755 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.095852 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.096074 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.096163 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.096394 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.096558 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.096872 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.096988 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.097327 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.097433 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.097524 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.097633 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.097888 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.097982 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.098818 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.098959 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.099105 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.099253 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.099392 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.099538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.099678 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.099823 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.100285 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.100435 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.100523 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.100606 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.100688 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.100770 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.100850 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.100923 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.100995 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.101067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.101147 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.101221 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.101293 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.101372 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.101452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.101648 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.101839 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.102036 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.102206 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.102356 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.102535 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.102683 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.102837 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.102981 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.103135 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.103282 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.103431 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.103578 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.103726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.103873 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.104011 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.104147 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.104295 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.104448 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.104597 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.104735 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.104972 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.105115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.105252 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.105420 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.105645 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.105788 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.105936 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.106074 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.106252 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.106407 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.106556 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.106705 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.106844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.106980 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.107132 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.107279 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.107940 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.108175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.108554 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.108724 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.109152 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.109306 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.109445 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.109592 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.109740 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.109888 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.110037 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.110202 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.110340 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.110493 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.110756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.110941 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.111108 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.111245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.111393 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.111576 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.111713 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.111860 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.112008 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.112163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.112163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.112322 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.112405 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.112492 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.112573 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.112648 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.112727 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.112807 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.112887 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.112970 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.113052 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.113353 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.113503 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.113650 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.113800 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.113963 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.114101 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.114298 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.114448 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.114586 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.114778 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.114917 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.115056 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.115200 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.115353 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.115492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.115648 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.115858 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.116010 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.116114 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.116201 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.116284 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.116367 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.116582 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.116666 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.116889 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.116981 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.117198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.117280 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.117510 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.117606 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.117913 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.118018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.118105 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.118588 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.118794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.118794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.119174 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.119317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.119456 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.119606 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.119758 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.119892 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.120046 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.120253 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.120400 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.120550 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.120748 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.120896 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.121200 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.121346 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.121497 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.121684 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.121823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.122169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.122342 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.122494 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.122669 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.122821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.123098 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.123243 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.123989 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.124153 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.124305 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.124456 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.124594 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.124594 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.124876 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.125024 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.125162 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.125300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.125300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.125803 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.126034 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.126220 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.126359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.126359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.126645 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.126783 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.126934 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.127099 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.127099 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.127371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.127507 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.127703 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.127851 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.128190 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.128336 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.128488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.128817 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.129032 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.129210 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.129449 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.129601 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.129741 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.129890 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.129890 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.130283 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.130431 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.130431 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.130702 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.130839 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.130997 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.131148 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.131298 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.131567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.131717 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.131897 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.132064 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.132203 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.132509 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.132648 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.132820 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.133013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.133166 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.133423 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.133560 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.133735 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.133942 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.134092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.134377 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.134565 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.134704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.134891 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.135031 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.135315 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.135466 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.135624 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.135818 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.135957 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.136233 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.136410 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.136549 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.136738 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.136890 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.137176 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.137316 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.137580 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.137717 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.137891 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.138173 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.138624 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.138968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.139152 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.139255 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.139353 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.139353 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.139531 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.139728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.139941 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.140037 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.140347 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.140448 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.140657 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.140864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.141010 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.141188 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.141296 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.141507 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.141659 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.141826 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.141974 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.142249 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.142381 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.142589 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.142706 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.142908 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.143025 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.143228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.143333 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.143546 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.143649 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.143863 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.143966 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.144180 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.144274 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.144495 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.144600 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.144809 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.144903 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.145119 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.145214 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.145444 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.145554 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.145757 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.145860 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.146068 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.146340 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.146438 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.146540 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.146709 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.146804 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.147025 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.147127 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.147364 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.147498 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.147709 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.147809 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.148024 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.148126 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.148370 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.148496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.148684 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.148777 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.149002 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.149113 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.149315 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.149420 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.149627 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.149732 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.149941 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.150036 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.150274 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.150381 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.150590 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.150692 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.150904 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.151006 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.151217 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.151313 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.151529 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.151630 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.151839 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.151942 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.152146 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.152247 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.152476 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.152577 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.152789 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.152901 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.153095 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.153189 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.153408 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.153510 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.153714 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.153822 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.154029 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.154186 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.154361 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.154466 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.154685 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.154792 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.155107 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.155202 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.155421 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.155513 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.155730 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.155823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.156043 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.156137 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.156361 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.156468 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.156682 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.156780 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.157001 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.157097 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.157323 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.157430 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.157705 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.157835 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.158051 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.158180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.158480 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.158584 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.158796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.158899 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.159122 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.159213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.159417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.159522 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.159733 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.159830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.160064 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.160166 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.160373 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.160476 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.160684 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.160786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.160991 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.161093 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.161320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.161493 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.161629 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.161733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.161954 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.162070 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.162397 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.162492 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.162713 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.162819 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.163025 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.163133 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.163359 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.163452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.163671 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.163776 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.163980 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.164089 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.164296 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.164399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.164605 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.164707 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.164917 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.165025 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.165252 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.165439 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.165562 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.165814 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.165918 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.166150 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.166250 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.166493 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.166635 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.166802 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.166894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.167111 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.167203 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.167473 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.167565 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.167739 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.167837 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.168063 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.168145 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.168380 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.168463 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.168715 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.168823 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.169018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.169149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.169343 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.169436 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.169650 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.169742 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.169969 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.170206 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.170544 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.170879 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.171192 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.171504 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.171603 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.171817 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.171910 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.172127 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.172220 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.172436 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.172564 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.172770 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.172889 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.173086 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.173229 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.173652 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.173782 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.173975 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.174156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.174316 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.174492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.174628 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.174842 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.174936 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.175188 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.175291 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.175519 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.175619 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.175853 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.175948 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.176174 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.176276 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.176493 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.176608 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.176810 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.176899 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.177118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.177222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.177434 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.177550 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.177755 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.177869 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.178059 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.178169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.178396 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.178499 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.178713 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.178850 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.179027 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.179141 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.179337 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.179452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.179669 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.179780 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.179977 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.180086 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.180309 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.180414 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.180623 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.180731 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.180933 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.181034 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.181243 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.181344 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.181555 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.181663 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.181897 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.181997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.182235 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.182342 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.182552 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.182667 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.182855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.182952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.183171 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.183266 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.183479 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.183595 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.183789 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.183893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.184101 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.184198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.184418 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.184529 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.184726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.184831 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.185034 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.185137 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.185339 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.185441 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.185667 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.185761 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.185974 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.186075 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.186325 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.186423 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.186641 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.186737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.186946 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.187038 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.187261 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.187363 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.187569 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.187663 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.187916 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.188151 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.188258 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.188486 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.188588 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.188811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.188926 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.189160 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.189265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.189484 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.189589 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.189797 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.189901 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.190148 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.190242 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.190482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.190571 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.190800 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.190893 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.191116 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.191213 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.191435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.191536 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.191754 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.191862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.192073 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.192168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.192392 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.192485 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.192705 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.192813 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.193025 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.193125 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.193342 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.193443 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.193661 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.193763 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.193980 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.194244 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.194356 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.194582 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.194708 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.194904 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.195010 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.195221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.195318 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.195538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.195649 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.195852 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.195949 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.196168 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.196271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.196482 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.196591 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.196796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.196910 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.197117 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.197214 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.197434 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.197536 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.197753 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.197851 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.198072 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.198203 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.198417 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.198528 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.198743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.198848 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.199064 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.199166 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.199384 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.199487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.199702 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.199805 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.200019 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.200123 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.200381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.200496 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.200686 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.200859 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.200994 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.201177 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.201311 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.201516 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.201631 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.201845 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.201954 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.202197 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.202309 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.202522 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.202618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.202844 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.202949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.203172 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.203274 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.203484 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.203581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.203792 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.203895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.204107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.204209 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.204416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.204517 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.204794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.204969 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.205113 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.205202 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.205421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.205517 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.205731 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.205826 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.206053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.206187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.206397 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.206498 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.206926 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.207032 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.207253 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.207360 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.207592 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.207689 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.207922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.208018 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.208254 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.208351 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.208577 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.208701 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.208895 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.209032 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.209223 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.209335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.209532 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.209636 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.209842 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.209934 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.210173 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.210325 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.210508 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.210640 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.210818 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.210943 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.211112 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.211253 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.211427 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.211557 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.211736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.211873 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.212058 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.212182 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.212369 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.212496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.212804 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.212904 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.213134 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.213261 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.213446 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.213586 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.213758 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.213924 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.214067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.214319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.214494 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.214646 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.214740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.214963 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.215056 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.215295 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.215397 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.215602 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.215696 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.215912 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.216005 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.216220 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.216313 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.216534 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.216635 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.216841 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.216941 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.217154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.217247 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.217463 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.217559 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.217777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.217869 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.218090 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.218221 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.218427 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.218542 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.218739 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.218840 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.219071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.219173 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.219384 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.219497 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.219693 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.219803 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.220004 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.220106 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.220401 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.220505 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.220721 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.220847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.221077 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.221195 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.221400 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.221505 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.221745 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.221943 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.222065 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.222310 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.222413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.222640 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.222742 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.222980 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.223076 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.223303 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.223402 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.223613 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.223721 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.223921 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.224015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.224233 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.224334 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.224564 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.224668 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.224880 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.224981 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.225195 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.225290 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.225507 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.225616 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.225819 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.225919 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.226156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.226260 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.226473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.226584 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.226783 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.226893 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.227096 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.227192 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.227410 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.227506 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.227727 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.227977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.228072 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.228320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.228435 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.228636 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.228729 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.228953 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.229047 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.229294 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.229413 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.229612 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.229724 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.229920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.230014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.230253 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.230351 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.230574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.230717 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.230890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.231004 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.231204 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.231300 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.231514 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.231615 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.231823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.231924 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.232136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.232240 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.232794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.232898 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.233108 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.233259 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.233419 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.233513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.233728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.233850 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.234040 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.234201 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.234380 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.234530 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.234692 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.234858 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.235005 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.235171 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.235323 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.235498 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.235669 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.235828 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.236074 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.236200 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.236514 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.236668 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.236831 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.236927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.237154 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.237251 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.237470 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.237571 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.237785 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.237881 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.238100 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.238242 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.238438 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.238550 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.238756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.238849 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.239067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.239161 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.239384 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.239478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.239698 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.239825 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.240014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.240119 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.240325 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.240420 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.240632 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.240742 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.240966 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.241058 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.241308 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.241409 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.241563 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.241673 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.241873 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.241967 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.242206 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.242305 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.242526 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.242622 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.242834 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.242936 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.243144 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.243238 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.243454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.243556 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.243764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.243887 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.244073 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.244219 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.244399 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.244532 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.244680 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.244844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.244986 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.245152 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.245294 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.245465 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.245586 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.245788 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.245881 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.246101 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.246234 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.246429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.246550 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.246736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.246890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.247051 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.247210 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.247363 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.247541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.247670 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.247860 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.247980 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.248189 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.248291 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.248506 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.248626 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.248833 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.248947 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.249162 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.249260 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.249473 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.249577 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.249781 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.249882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.250088 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.250204 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.250416 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.250511 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.250729 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.250825 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.251035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.251138 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.251344 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.251446 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.251680 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.251782 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.251990 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.252087 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.252320 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.252423 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.252652 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.252749 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.252967 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.253063 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.253297 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.253404 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.253620 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.253716 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.253943 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.254048 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.254291 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.254401 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.254609 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.254707 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.254936 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.255030 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.255247 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.255352 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.255561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.255664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.255873 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.255968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.256188 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.256292 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.256504 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.256617 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.256819 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.256921 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.257140 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.257245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.257476 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.257581 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.257771 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.257867 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.258085 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.258201 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.258440 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.258535 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.258770 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.258864 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.259080 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.259181 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.259409 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.259506 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.259726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.259822 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.260047 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.260168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.260366 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.260463 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.260683 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.260789 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.260991 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.261089 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.261243 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 13:01:31.261329 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.261619 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.261941 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.262279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.262597 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.262917 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.263237 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.263568 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.263899 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.264214 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.264544 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.264875 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.265227 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.265543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.265888 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.266247 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.266571 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.266888 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.267351 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 13:01:31.267646 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117727) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 13:01:31.321373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO dbcounter [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] Registered counter for database nova_api Jun 03 13:01:31.327519 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO dbcounter [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] Registered counter for database nova_api Jun 03 13:01:31.342970 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_db.sqlalchemy.engines [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:01:31.347589 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_db.sqlalchemy.engines [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:01:31.349781 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writer thread running {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:01:31.354485 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writer thread running {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:01:31.408574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.context [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),55a1a63d-d44c-44ec-ac39-183e23168b3e(cell1) {{(pid=117726) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 13:01:31.412741 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:01:31.413403 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.context [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),55a1a63d-d44c-44ec-ac39-183e23168b3e(cell1) {{(pid=117727) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 13:01:31.414334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:01:31.415186 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:01:31.417152 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:01:31.417521 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:01:31.419160 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:01:31.419332 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO dbcounter [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] Registered counter for database nova_cell0 Jun 03 13:01:31.419979 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:01:31.422059 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:01:31.423199 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO dbcounter [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] Registered counter for database nova_cell1 Jun 03 13:01:31.424139 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO dbcounter [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] Registered counter for database nova_cell0 Jun 03 13:01:31.428265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO dbcounter [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] Registered counter for database nova_cell1 Jun 03 13:01:31.430894 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_db.sqlalchemy.engines [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:01:31.432445 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_db.sqlalchemy.engines [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:01:31.435619 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_db.sqlalchemy.engines [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:01:31.438593 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writer thread running {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:01:31.439141 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_db.sqlalchemy.engines [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:01:31.444768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writer thread running {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:01:31.450766 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writer thread running {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:01:31.580769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writer thread running {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:01:31.591409 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO dbcounter [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] Registered counter for database nova_cell0 Jun 03 13:01:31.598452 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_db.sqlalchemy.engines [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:01:31.600326 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO dbcounter [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] Registered counter for database nova_cell0 Jun 03 13:01:31.603861 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writer thread running {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:01:31.608870 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_db.sqlalchemy.engines [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117727) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 13:01:31.614309 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writer thread running {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 13:01:32.047652 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: WARNING keystonemiddleware.auth_token [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 13:01:32.052996 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: WARNING keystonemiddleware.auth_token [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 13:01:32.055151 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: WARNING keystonemiddleware.auth_token [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 13:01:32.060569 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: WARNING keystonemiddleware.auth_token [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 13:01:32.277602 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: WARNING keystonemiddleware.auth_token [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 13:01:32.279932 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: WARNING keystonemiddleware.auth_token [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 13:01:32.283842 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: WARNING keystonemiddleware.auth_token [None req-9e9b2e83-adbf-4c67-869c-73701c3de47b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 13:01:32.286424 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: WARNING keystonemiddleware.auth_token [None req-f60bbb6e-8d95-4828-bbde-b5ab0b1e73d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 13:01:32.289541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c7122f79c0 pid: 117726 (default app) Jun 03 13:01:32.291830 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c7122f79c0 pid: 117727 (default app) Jun 03 13:02:14.582087 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:14.588619 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:14.591424 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:14.592360 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:15.660198 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:15.666322 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:15.667310 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:15.669220 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:16.467632 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0ea43756-f064-4023-8a1c-50abccc72736 tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] Action: 'create', calling method: .version_select at 0x7fc5a6318310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1027390667", "metadata": {"Type": "work"}}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:02:17.141785 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-728729845", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "networks": [{"uuid": "74d5faa5-85bd-4978-8f3b-d5f0c11538e7"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:02:17.573840 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] validate_networks() for [('74d5faa5-85bd-4978-8f3b-d5f0c11538e7', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:02:18.177380 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0ea43756-f064-4023-8a1c-50abccc72736 tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.602786 Jun 03 13:02:18.182299 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1155 bytes} [Fri Jun 3 13:02:14 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3610 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 13:02:18.192809 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-db55e202-0775-4233-abdc-a5b23af5b888 tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] Calling method '.version_select at 0x7fc5a61e1310>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:18.354132 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-db55e202-0775-4233-abdc-a5b23af5b888 tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f" status: 200 len: 353 microversion: 2.1 time: 0.162553 Jun 03 13:02:18.356717 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 2/2] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:02:18 2022] GET /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:02:19.030980 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f6a1665a-853a-429c-81ca-0e67d8571f86 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] Calling method '.version_select at 0x7fc5a61e14c0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:19.165602 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f6a1665a-853a-429c-81ca-0e67d8571f86 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/d4c29d85-b56c-4241-a489-c584e6251934" status: 200 len: 350 microversion: 2.1 time: 0.139171 Jun 03 13:02:19.166427 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 3/3] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:02:19 2022] GET /compute/v2.1/os-volumes/d4c29d85-b56c-4241-a489-c584e6251934 => generated 350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:02:19.371263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8caad074-07a5-47f3-848f-f2a08f1eb5b7 tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] Calling method '.version_select at 0x7fc5a61e1af0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:19.394404 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:02:19.395448 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:02:19.396065 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:02:19.398031 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:02:19.398637 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:02:19.431371 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:19.435749 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:19.440527 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:19.445303 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:19.525312 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8caad074-07a5-47f3-848f-f2a08f1eb5b7 tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f" status: 200 len: 354 microversion: 2.1 time: 0.158862 Jun 03 13:02:19.526101 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 4/4] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:02:19 2022] GET /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f => generated 354 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:02:19.541571 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3f67d194-7ca1-4473-90ad-09ba116be45f tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] Calling method '.version_select at 0x7fc5a617a1f0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:19.599695 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Getting quotas for project 4dd12390001445ba8e59d21bd11b34f4. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:02:19.620824 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Getting quotas for user 8635705162e04b8fae768d98c5c672c2 and project 4dd12390001445ba8e59d21bd11b34f4. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:02:19.707437 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:02:19.710907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:02:19.725060 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3f67d194-7ca1-4473-90ad-09ba116be45f tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f" status: 200 len: 354 microversion: 2.1 time: 0.190529 Jun 03 13:02:19.726065 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 5/5] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:02:19 2022] GET /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f => generated 354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:02:19.746426 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-443cf849-1af4-4ddc-9cd3-ad2bc029dbb6 tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] Calling method '.version_select at 0x7fc5a61e1c10>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:19.939361 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9139deba-aaec-42b0-9265-0300b663f82e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.291697 Jun 03 13:02:19.940795 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 1/6] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:02:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 13:02:19.960832 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-443cf849-1af4-4ddc-9cd3-ad2bc029dbb6 tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f" status: 202 len: 0 microversion: 2.1 time: 0.219645 Jun 03 13:02:19.961377 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-677b111e-05a6-49c8-aef3-09944d1c377d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:19.961735 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 6/7] 10.222.0.58 () {58 vars in 1247 bytes} [Fri Jun 3 13:02:19 2022] DELETE /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:02:19.963616 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-677b111e-05a6-49c8-aef3-09944d1c377d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:19.973539 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bbae21a2-c8a7-4118-9dce-114b21e924f9 tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] Calling method '.version_select at 0x7fc5a61e1280>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:20.098724 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bbae21a2-c8a7-4118-9dce-114b21e924f9 tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f" status: 200 len: 353 microversion: 2.1 time: 0.131391 Jun 03 13:02:20.099569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 7/8] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:02:19 2022] GET /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:02:20.200556 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-677b111e-05a6-49c8-aef3-09944d1c377d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:20.238809 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-677b111e-05a6-49c8-aef3-09944d1c377d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1214 microversion: 2.1 time: 0.282205 Jun 03 13:02:20.239611 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 2/9] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:19 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1214 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:20.653748 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2086474101", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:02:20.858411 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] validate_networks() for [('1a5e9bbf-ee2a-49a3-8bbe-71deaba31087', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:02:20.978376 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ad2b3d62-4ca2-4e62-aae7-ce9d6c48aa68 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] Calling method '.version_select at 0x7fc5a591a3a0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:21.119246 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ad2b3d62-4ca2-4e62-aae7-ce9d6c48aa68 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/5f12d5be-7d71-447f-b4ab-dd3708cf296d" status: 200 len: 351 microversion: 2.1 time: 0.145311 Jun 03 13:02:21.126507 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 3/10] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:02:20 2022] GET /compute/v2.1/os-volumes/5f12d5be-7d71-447f-b4ab-dd3708cf296d => generated 351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:02:21.131767 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-16831578-03e1-4ab1-adbe-9b39423034dc tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] Calling method '.version_select at 0x7fc5a509ee50>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:21.209691 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-16831578-03e1-4ab1-adbe-9b39423034dc tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] HTTP exception thrown: Volume cb59f112-ba8e-4647-8770-44429073d71f could not be found. Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-16831578-03e1-4ab1-adbe-9b39423034dc tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] Request method failure captured: Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f HTTP/1.1 Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZWvzOv9BODNnDc-RyJ1BDvtwrm2Ps6b-nEV3vJk55AGOrpe5ij2kLbfFMH1-4kNQWZRHJIJK11wLbYo2jWp88OF2dp-I39k155QQk87HeThJkufq7hO4exufHWON6cbeJkYy-9PhnTk12d46yL7pFSVctuPZRISSVgBhjXhkiQBu8 Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 8e7d9b1177e144139b715e6cea199b1a Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesGetTestJSON-962124555 Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:02:21.213883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e7d9b1177e144139b715e6cea199b1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e7d9b1177e144139b715e6cea199b1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e7d9b1177e144139b715e6cea199b1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e7d9b1177e144139b715e6cea199b1a"}]}] Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesGetTestJSON-962124555 Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 8e7d9b1177e144139b715e6cea199b1a Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesGetTestJSON-962124555 Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesGetTestJSON-962124555-project Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 2cfcc948ff3742e8a4d6cb288f08b6bc Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesGetTestJSON-962124555-project Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Volume cb59f112-ba8e-4647-8770-44429073d71f could not be found. Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': 'cb59f112-ba8e-4647-8770-44429073d71f'} Jun 03 13:02:21.215062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb59f112-ba8e-4647-8770-44429073d71f could not be found. (HTTP 404) (Request-ID: req-0d8d8524-cbb6-45f1-a7c1-9771900802f7) Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:02:21.215793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:02:21.217071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb59f112-ba8e-4647-8770-44429073d71f could not be found. Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 13:02:21.218133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb59f112-ba8e-4647-8770-44429073d71f could not be found. Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb59f112-ba8e-4647-8770-44429073d71f could not be found. Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-16831578-03e1-4ab1-adbe-9b39423034dc tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] Returning 404 to user: Volume cb59f112-ba8e-4647-8770-44429073d71f could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-16831578-03e1-4ab1-adbe-9b39423034dc tempest-VolumesGetTestJSON-962124555 tempest-VolumesGetTestJSON-962124555-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f" status: 404 len: 109 microversion: 2.1 time: 0.087669 Jun 03 13:02:21.221176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 4/11] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:02:21 2022] GET /compute/v2.1/os-volumes/cb59f112-ba8e-4647-8770-44429073d71f => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:02:21.256631 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-83277fae-e4e8-4317-a6d4-24554e2c14a2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:21.257187 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-83277fae-e4e8-4317-a6d4-24554e2c14a2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:21.385476 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-83277fae-e4e8-4317-a6d4-24554e2c14a2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:21.394607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-83277fae-e4e8-4317-a6d4-24554e2c14a2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1214 microversion: 2.1 time: 0.141942 Jun 03 13:02:21.398265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 5/12] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:21 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:22.412808 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bbd45a66-40c2-4452-a484-b12e7bc3bc43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:22.414083 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bbd45a66-40c2-4452-a484-b12e7bc3bc43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:22.430450 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbd45a66-40c2-4452-a484-b12e7bc3bc43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:22.441958 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbd45a66-40c2-4452-a484-b12e7bc3bc43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:22.443213 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbd45a66-40c2-4452-a484-b12e7bc3bc43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:22.443679 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbd45a66-40c2-4452-a484-b12e7bc3bc43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:22.761226 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bbd45a66-40c2-4452-a484-b12e7bc3bc43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:22.778746 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bbd45a66-40c2-4452-a484-b12e7bc3bc43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1218 microversion: 2.1 time: 0.369948 Jun 03 13:02:22.780906 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 6/13] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:22 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1218 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:22.839791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6b02b1b3-8b36-408d-bb8b-9f961bb28604 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] Calling method '.version_select at 0x7fc5a4f8a0d0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:22.970002 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6b02b1b3-8b36-408d-bb8b-9f961bb28604 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/011693b0-1906-47c4-9d1f-8349009695c7" status: 200 len: 351 microversion: 2.1 time: 0.134694 Jun 03 13:02:22.971302 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 7/14] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:02:22 2022] GET /compute/v2.1/os-volumes/011693b0-1906-47c4-9d1f-8349009695c7 => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:02:22.983372 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a19981c0-f3f9-4633-b736-2f4dc15d64fe tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] Calling method '.version_select at 0x7fc5a4f8a820>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:23.184403 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a19981c0-f3f9-4633-b736-2f4dc15d64fe tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.205783 Jun 03 13:02:23.192521 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 8/15] 10.222.0.58 () {58 vars in 1133 bytes} [Fri Jun 3 13:02:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:23.199026 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8ae1a2a0-5ef1-4031-9a65-134ac26c2425 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] Calling method '.version_select at 0x7fc5a4f8a8b0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:23.325543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8ae1a2a0-5ef1-4031-9a65-134ac26c2425 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.130539 Jun 03 13:02:23.326469 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 9/16] 10.222.0.58 () {58 vars in 1148 bytes} [Fri Jun 3 13:02:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:02:23.344409 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f82b793d-693b-44c1-b2bb-3e09d06d0e1a tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] Calling method '.version_select at 0x7fc5a4f76d30>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:23.364132 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:02:23.364809 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:02:23.365405 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:02:23.365874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:02:23.366458 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:02:23.392573 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:23.393026 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:23.393834 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:23.394302 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:23.427928 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Getting quotas for project 45170704be9845929be13eb3a96eeb07. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:02:23.435869 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Getting quotas for user 010c4d5ba6b847b79d3127787db2ddd6 and project 45170704be9845929be13eb3a96eeb07. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:02:23.448595 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:02:23.451476 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:02:23.596535 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f82b793d-693b-44c1-b2bb-3e09d06d0e1a tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.260678 Jun 03 13:02:23.598031 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 10/17] 10.222.0.58 () {58 vars in 1133 bytes} [Fri Jun 3 13:02:23 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:23.610276 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ad2fdd43-8c1d-4f55-ae62-74017af6f359 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] Calling method '.version_select at 0x7fc5a4f963a0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:23.629029 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-525d9344-3794-46c4-9f19-dcc67cedb27c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.359508 Jun 03 13:02:23.633640 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 8/18] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:02:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 3365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:02:23.654189 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d77f45e8-b160-422d-a947-06d988b96eb5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:23.654906 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d77f45e8-b160-422d-a947-06d988b96eb5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:23.806285 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ad2fdd43-8c1d-4f55-ae62-74017af6f359 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.199577 Jun 03 13:02:23.807518 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 11/19] 10.222.0.58 () {58 vars in 1166 bytes} [Fri Jun 3 13:02:23 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:02:23.815360 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2d579953-3b4b-4b8a-a847-93f0e69aa31b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:23.816220 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2d579953-3b4b-4b8a-a847-93f0e69aa31b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:23.827042 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d579953-3b4b-4b8a-a847-93f0e69aa31b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:23.833803 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d579953-3b4b-4b8a-a847-93f0e69aa31b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:23.834903 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d579953-3b4b-4b8a-a847-93f0e69aa31b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:23.835544 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d579953-3b4b-4b8a-a847-93f0e69aa31b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:23.839094 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d77f45e8-b160-422d-a947-06d988b96eb5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:23.880583 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d77f45e8-b160-422d-a947-06d988b96eb5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1222 microversion: 2.1 time: 0.236634 Jun 03 13:02:23.894155 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 9/20] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:23 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1222 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:23.895702 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ee3ed579-0e98-4ddc-896a-024a3fdcc461 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] Calling method '.version_select at 0x7fc5a588a0d0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:24.159791 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ee3ed579-0e98-4ddc-896a-024a3fdcc461 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.276272 Jun 03 13:02:24.161152 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 10/21] 10.222.0.58 () {58 vars in 1169 bytes} [Fri Jun 3 13:02:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:02:24.166661 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-955317878", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:02:24.341603 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] validate_networks() for [('1a5e9bbf-ee2a-49a3-8bbe-71deaba31087', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:02:24.398472 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2d579953-3b4b-4b8a-a847-93f0e69aa31b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:24.411815 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2d579953-3b4b-4b8a-a847-93f0e69aa31b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1272 microversion: 2.1 time: 0.601557 Jun 03 13:02:24.422158 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 12/22] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:23 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1272 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:24.438842 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-479f9924-8452-4df4-9c74-a23dd9b41727 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] Calling method '.version_select at 0x7fc5a4f96700>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:24.727124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-479f9924-8452-4df4-9c74-a23dd9b41727 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.312002 Jun 03 13:02:24.728180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 13/23] 10.222.0.58 () {58 vars in 1154 bytes} [Fri Jun 3 13:02:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:24.750907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1d133f03-0200-4c8f-89c7-16e136751295 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] Calling method '.version_select at 0x7fc5a4f564c0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:24.987647 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1d133f03-0200-4c8f-89c7-16e136751295 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.251420 Jun 03 13:02:24.988881 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 14/24] 10.222.0.58 () {58 vars in 1187 bytes} [Fri Jun 3 13:02:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:02:25.001800 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-88a940b5-ac33-4e67-b68c-f577aa310fb6 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] Calling method '.version_select at 0x7fc5a4f39b80>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:25.286748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-88a940b5-ac33-4e67-b68c-f577aa310fb6 tempest-VolumesTestJSON-1387146781 tempest-VolumesTestJSON-1387146781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.290029 Jun 03 13:02:25.287403 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 15/25] 10.222.0.58 () {58 vars in 1154 bytes} [Fri Jun 3 13:02:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:25.433001 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-090256a1-4124-4aed-8f5b-7f4c4de45921 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:25.433728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-090256a1-4124-4aed-8f5b-7f4c4de45921 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:25.457216 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-090256a1-4124-4aed-8f5b-7f4c4de45921 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:25.457690 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-090256a1-4124-4aed-8f5b-7f4c4de45921 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:25.492110 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-090256a1-4124-4aed-8f5b-7f4c4de45921 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:25.493041 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-090256a1-4124-4aed-8f5b-7f4c4de45921 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:26.138059 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-090256a1-4124-4aed-8f5b-7f4c4de45921 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:26.156710 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-090256a1-4124-4aed-8f5b-7f4c4de45921 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1272 microversion: 2.1 time: 0.724311 Jun 03 13:02:26.162517 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 16/26] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:25 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1272 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:26.587949 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:02:26.587949 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:02:26.587949 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:02:26.588927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:02:26.589963 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:02:26.635303 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:26.639844 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:26.645577 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:26.649234 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:26.731899 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Getting quotas for project 45170704be9845929be13eb3a96eeb07. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:02:26.751453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Getting quotas for user 010c4d5ba6b847b79d3127787db2ddd6 and project 45170704be9845929be13eb3a96eeb07. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:02:26.794767 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:02:26.804079 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:02:26.961726 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-84414020-3244-4ed2-9c2c-31afc617981f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.799157 Jun 03 13:02:26.962446 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 11/27] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:02:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:02:26.974316 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-228c1e4b-865d-4ed1-87cf-5766382a1cf2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:26.975395 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-228c1e4b-865d-4ed1-87cf-5766382a1cf2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:27.184613 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2fe36a21-add8-431a-8491-8db49d36548b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:27.185594 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2fe36a21-add8-431a-8491-8db49d36548b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:27.224934 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2fe36a21-add8-431a-8491-8db49d36548b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:27.227122 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2fe36a21-add8-431a-8491-8db49d36548b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:27.230299 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2fe36a21-add8-431a-8491-8db49d36548b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:27.231223 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2fe36a21-add8-431a-8491-8db49d36548b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:28.606457 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-228c1e4b-865d-4ed1-87cf-5766382a1cf2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:28.619542 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-228c1e4b-865d-4ed1-87cf-5766382a1cf2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1221 microversion: 2.1 time: 1.646388 Jun 03 13:02:28.627441 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 17/28] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:26 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1221 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:28.876671 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2fe36a21-add8-431a-8491-8db49d36548b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:28.905487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2fe36a21-add8-431a-8491-8db49d36548b tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1272 microversion: 2.1 time: 1.723745 Jun 03 13:02:28.906756 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 12/29] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:27 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1272 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:29.633302 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-923f07ab-3ad6-49d5-9459-9dce97d7c642 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:29.633933 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-923f07ab-3ad6-49d5-9459-9dce97d7c642 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:29.643694 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:29.646325 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-923f07ab-3ad6-49d5-9459-9dce97d7c642 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:29.654759 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-923f07ab-3ad6-49d5-9459-9dce97d7c642 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:29.655865 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-923f07ab-3ad6-49d5-9459-9dce97d7c642 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:29.660589 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-923f07ab-3ad6-49d5-9459-9dce97d7c642 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:29.923577 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-baa43ba9-cd23-4b5c-94bc-8594c5c9bd3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:29.924231 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-baa43ba9-cd23-4b5c-94bc-8594c5c9bd3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:29.948870 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-baa43ba9-cd23-4b5c-94bc-8594c5c9bd3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:29.958243 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-baa43ba9-cd23-4b5c-94bc-8594c5c9bd3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:29.959228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-baa43ba9-cd23-4b5c-94bc-8594c5c9bd3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:29.959725 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-baa43ba9-cd23-4b5c-94bc-8594c5c9bd3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:30.915035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-923f07ab-3ad6-49d5-9459-9dce97d7c642 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:30.927066 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-923f07ab-3ad6-49d5-9459-9dce97d7c642 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1281 microversion: 2.1 time: 1.297603 Jun 03 13:02:30.943253 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 18/30] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:29 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1281 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:31.203375 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-baa43ba9-cd23-4b5c-94bc-8594c5c9bd3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:31.211893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-baa43ba9-cd23-4b5c-94bc-8594c5c9bd3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 1.293066 Jun 03 13:02:31.216031 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 13/31] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:29 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:31.961795 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8eebd62e-b4b6-467e-8ff6-db29d3d60199 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:31.962570 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8eebd62e-b4b6-467e-8ff6-db29d3d60199 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:31.976293 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8eebd62e-b4b6-467e-8ff6-db29d3d60199 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:31.976748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8eebd62e-b4b6-467e-8ff6-db29d3d60199 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:31.977650 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8eebd62e-b4b6-467e-8ff6-db29d3d60199 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:31.988683 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8eebd62e-b4b6-467e-8ff6-db29d3d60199 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:32.238632 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6273dd7b-96d5-4ba8-82f2-fb92433e3b65 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:32.239848 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6273dd7b-96d5-4ba8-82f2-fb92433e3b65 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:32.261272 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6273dd7b-96d5-4ba8-82f2-fb92433e3b65 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:32.262181 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6273dd7b-96d5-4ba8-82f2-fb92433e3b65 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:32.272549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6273dd7b-96d5-4ba8-82f2-fb92433e3b65 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:32.273891 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6273dd7b-96d5-4ba8-82f2-fb92433e3b65 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:32.399363 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8eebd62e-b4b6-467e-8ff6-db29d3d60199 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:32.407589 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8eebd62e-b4b6-467e-8ff6-db29d3d60199 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1279 microversion: 2.1 time: 0.450868 Jun 03 13:02:32.426542 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 19/32] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:31 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1279 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:33.440858 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a3355442-31b4-41b6-955b-a1e2ec42dfce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:33.443132 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a3355442-31b4-41b6-955b-a1e2ec42dfce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:33.466597 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3355442-31b4-41b6-955b-a1e2ec42dfce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:33.467320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3355442-31b4-41b6-955b-a1e2ec42dfce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:33.470441 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3355442-31b4-41b6-955b-a1e2ec42dfce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:33.472268 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a3355442-31b4-41b6-955b-a1e2ec42dfce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:33.947599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a3355442-31b4-41b6-955b-a1e2ec42dfce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:33.959941 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a3355442-31b4-41b6-955b-a1e2ec42dfce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1279 microversion: 2.1 time: 0.524827 Jun 03 13:02:33.963530 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 20/33] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:33 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1279 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:34.013539 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6273dd7b-96d5-4ba8-82f2-fb92433e3b65 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:34.025194 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6273dd7b-96d5-4ba8-82f2-fb92433e3b65 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 1.796031 Jun 03 13:02:34.037482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 14/34] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:32 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:34.987429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f8846370-c76a-4dda-a8ea-205b6d29abc3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:34.988623 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f8846370-c76a-4dda-a8ea-205b6d29abc3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:35.003394 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8846370-c76a-4dda-a8ea-205b6d29abc3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:35.003983 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8846370-c76a-4dda-a8ea-205b6d29abc3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:35.005717 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8846370-c76a-4dda-a8ea-205b6d29abc3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:35.006387 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8846370-c76a-4dda-a8ea-205b6d29abc3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:35.044796 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6fbe6340-a71e-4ff3-bbe7-ee14feb0318a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:35.045573 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6fbe6340-a71e-4ff3-bbe7-ee14feb0318a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:35.054049 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6fbe6340-a71e-4ff3-bbe7-ee14feb0318a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:35.066936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6fbe6340-a71e-4ff3-bbe7-ee14feb0318a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:35.075307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6fbe6340-a71e-4ff3-bbe7-ee14feb0318a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:35.076008 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6fbe6340-a71e-4ff3-bbe7-ee14feb0318a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:35.381469 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f8846370-c76a-4dda-a8ea-205b6d29abc3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:35.412808 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f8846370-c76a-4dda-a8ea-205b6d29abc3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1279 microversion: 2.1 time: 0.434254 Jun 03 13:02:35.430803 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 21/35] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:34 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1279 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:35.822596 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6fbe6340-a71e-4ff3-bbe7-ee14feb0318a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:35.831254 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6fbe6340-a71e-4ff3-bbe7-ee14feb0318a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.790590 Jun 03 13:02:35.835831 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 15/36] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:35 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:36.231754 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-07ab023a-d12b-43ea-af23-3336dfce28b9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: .version_select at 0x7fc5a4f569d0>, body: {"keypair": {"name": "tempest-keypair-897276757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdJ+b8uyLZrTjR7IU7j1+iIjiwHMK7NKC8410qkoAEVqGPOEi6/CvIqznFes3gr5WdcHx7WcoxM968i2ee+sdaWa8DBD7nzYPsIIu4/ALhpfBXoKeI3kZjmR/neKRVFHA=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:02:36.302955 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-07ab023a-d12b-43ea-af23-3336dfce28b9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:02:36.320492 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-07ab023a-d12b-43ea-af23-3336dfce28b9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for user f2217b3c134d453fbdcb14853eed4e3b and project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:02:36.423586 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-07ab023a-d12b-43ea-af23-3336dfce28b9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.705672 Jun 03 13:02:36.433655 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ba0d6b6e-d29e-423a-865b-ee586aa1bffb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:36.434333 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 22/37] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Jun 3 13:02:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:02:36.435336 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ba0d6b6e-d29e-423a-865b-ee586aa1bffb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:36.452019 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba0d6b6e-d29e-423a-865b-ee586aa1bffb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:36.454883 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba0d6b6e-d29e-423a-865b-ee586aa1bffb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:36.457674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba0d6b6e-d29e-423a-865b-ee586aa1bffb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:36.460695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ba0d6b6e-d29e-423a-865b-ee586aa1bffb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:36.693884 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=4 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:36.764716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=14 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:36.852461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b1e7020e-c99b-4057-b025-f1a98b1619ef tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:36.853089 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b1e7020e-c99b-4057-b025-f1a98b1619ef tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:36.868151 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1e7020e-c99b-4057-b025-f1a98b1619ef tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:36.868609 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1e7020e-c99b-4057-b025-f1a98b1619ef tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:36.869406 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1e7020e-c99b-4057-b025-f1a98b1619ef tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:36.875037 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1e7020e-c99b-4057-b025-f1a98b1619ef tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:36.986192 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ba0d6b6e-d29e-423a-865b-ee586aa1bffb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:37.008256 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ba0d6b6e-d29e-423a-865b-ee586aa1bffb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.580396 Jun 03 13:02:37.015615 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 16/38] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:36 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:37.631924 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b1e7020e-c99b-4057-b025-f1a98b1619ef tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:37.650806 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b1e7020e-c99b-4057-b025-f1a98b1619ef tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.793973 Jun 03 13:02:37.664332 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 23/39] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:36 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:38.037786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-78949d4f-e636-4def-8774-abe4d7b9418c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:38.040185 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-78949d4f-e636-4def-8774-abe4d7b9418c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:38.073251 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-78949d4f-e636-4def-8774-abe4d7b9418c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:38.076405 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-78949d4f-e636-4def-8774-abe4d7b9418c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:38.078178 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-78949d4f-e636-4def-8774-abe4d7b9418c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:38.079145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-78949d4f-e636-4def-8774-abe4d7b9418c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:38.564643 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-1f72cf43-441e-413a-896d-7b044831ea16 req-a7e89322-b7ed-411e-ad05-ddd5d2bdada1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730b6a27-293e-4481-8a66-c4b15dccceeb", "tag": "6df05199-0112-4ee8-a950-61d4404cd566"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:02:38.602693 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1f72cf43-441e-413a-896d-7b044831ea16 req-a7e89322-b7ed-411e-ad05-ddd5d2bdada1 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:38.605119 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1f72cf43-441e-413a-896d-7b044831ea16 req-a7e89322-b7ed-411e-ad05-ddd5d2bdada1 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:38.692735 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-1f72cf43-441e-413a-896d-7b044831ea16 req-a7e89322-b7ed-411e-ad05-ddd5d2bdada1 service nova] Creating event network-changed:6df05199-0112-4ee8-a950-61d4404cd566 for instance 730b6a27-293e-4481-8a66-c4b15dccceeb on hv-cinder-77954 Jun 03 13:02:38.695151 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1f72cf43-441e-413a-896d-7b044831ea16 req-a7e89322-b7ed-411e-ad05-ddd5d2bdada1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 13:02:38.697555 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a263f0a-2f41-4f39-8b0f-a5b9d19ca998 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:38.700112 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a263f0a-2f41-4f39-8b0f-a5b9d19ca998 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:38.703513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a263f0a-2f41-4f39-8b0f-a5b9d19ca998 None None] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:38.704972 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a263f0a-2f41-4f39-8b0f-a5b9d19ca998 None None] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:38.742700 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.compute.rpcapi [None req-1a263f0a-2f41-4f39-8b0f-a5b9d19ca998 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 13:02:38.747234 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1a263f0a-2f41-4f39-8b0f-a5b9d19ca998 None None] Releasing lock "compute-rpcapi-router" {{(pid=117727) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 13:02:38.789887 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-78949d4f-e636-4def-8774-abe4d7b9418c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:38.804049 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-78949d4f-e636-4def-8774-abe4d7b9418c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.774670 Jun 03 13:02:38.807557 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 17/40] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:38 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:38.819648 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d70df430-3bff-4462-a603-f5612aee2b3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:38.833132 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d70df430-3bff-4462-a603-f5612aee2b3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:38.850201 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d70df430-3bff-4462-a603-f5612aee2b3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:38.850925 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d70df430-3bff-4462-a603-f5612aee2b3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:38.853433 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d70df430-3bff-4462-a603-f5612aee2b3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:38.854504 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d70df430-3bff-4462-a603-f5612aee2b3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:38.881468 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1a263f0a-2f41-4f39-8b0f-a5b9d19ca998 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.633455 Jun 03 13:02:38.889041 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 24/41] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:02:39.826368 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1d310793-3113-4dcd-ae5c-16b8d739aeb7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:39.828395 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1d310793-3113-4dcd-ae5c-16b8d739aeb7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:39.839489 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d70df430-3bff-4462-a603-f5612aee2b3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:39.841961 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d310793-3113-4dcd-ae5c-16b8d739aeb7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:39.842523 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d310793-3113-4dcd-ae5c-16b8d739aeb7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:39.844427 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d310793-3113-4dcd-ae5c-16b8d739aeb7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:39.846822 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d310793-3113-4dcd-ae5c-16b8d739aeb7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:39.853722 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d70df430-3bff-4462-a603-f5612aee2b3d tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 1.043870 Jun 03 13:02:39.856049 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 18/42] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:38 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:40.214627 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-32073837-d381-4720-8a2e-cc9b0f85410b req-bb5b7fa2-7088-4c33-a1d2-339f79ba8230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8810fcf9-5763-45c2-9e84-9a12f2fa1447", "tag": "f3140ed5-b3f5-4f50-a9f6-76f75f5506d6"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:02:40.256199 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-32073837-d381-4720-8a2e-cc9b0f85410b req-bb5b7fa2-7088-4c33-a1d2-339f79ba8230 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:40.258174 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-32073837-d381-4720-8a2e-cc9b0f85410b req-bb5b7fa2-7088-4c33-a1d2-339f79ba8230 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:40.260082 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1d310793-3113-4dcd-ae5c-16b8d739aeb7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:40.275805 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1d310793-3113-4dcd-ae5c-16b8d739aeb7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.452220 Jun 03 13:02:40.285310 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 25/43] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:39 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:40.296504 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-32073837-d381-4720-8a2e-cc9b0f85410b req-bb5b7fa2-7088-4c33-a1d2-339f79ba8230 service nova] Creating event network-changed:f3140ed5-b3f5-4f50-a9f6-76f75f5506d6 for instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 on hv-cinder-77954 Jun 03 13:02:40.297803 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-32073837-d381-4720-8a2e-cc9b0f85410b req-bb5b7fa2-7088-4c33-a1d2-339f79ba8230 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 13:02:40.299208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-661595e1-0755-4f5a-9bba-d279b00a4618 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:40.299830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-661595e1-0755-4f5a-9bba-d279b00a4618 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:40.300842 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-661595e1-0755-4f5a-9bba-d279b00a4618 None None] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:40.301503 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-661595e1-0755-4f5a-9bba-d279b00a4618 None None] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:40.312881 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.compute.rpcapi [None req-661595e1-0755-4f5a-9bba-d279b00a4618 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 13:02:40.314288 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-661595e1-0755-4f5a-9bba-d279b00a4618 None None] Releasing lock "compute-rpcapi-router" {{(pid=117726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 13:02:40.355345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-661595e1-0755-4f5a-9bba-d279b00a4618 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393829 Jun 03 13:02:40.355985 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 19/44] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:02:40.873136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2df62d93-9b95-4e99-9d54-aff9c4e7283a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:40.873759 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2df62d93-9b95-4e99-9d54-aff9c4e7283a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:40.883868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2df62d93-9b95-4e99-9d54-aff9c4e7283a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:40.886898 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2df62d93-9b95-4e99-9d54-aff9c4e7283a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:40.888037 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2df62d93-9b95-4e99-9d54-aff9c4e7283a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:40.888683 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2df62d93-9b95-4e99-9d54-aff9c4e7283a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:41.295181 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ed8f653a-02da-4e3f-a7f8-4d94f1136335 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:41.296204 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ed8f653a-02da-4e3f-a7f8-4d94f1136335 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:41.327662 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ed8f653a-02da-4e3f-a7f8-4d94f1136335 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:41.330700 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ed8f653a-02da-4e3f-a7f8-4d94f1136335 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:41.335076 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ed8f653a-02da-4e3f-a7f8-4d94f1136335 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:41.338225 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ed8f653a-02da-4e3f-a7f8-4d94f1136335 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:41.983458 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2df62d93-9b95-4e99-9d54-aff9c4e7283a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:41.995141 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2df62d93-9b95-4e99-9d54-aff9c4e7283a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 1.126043 Jun 03 13:02:41.996067 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 26/45] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:40 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:42.038147 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ed8f653a-02da-4e3f-a7f8-4d94f1136335 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:42.048185 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ed8f653a-02da-4e3f-a7f8-4d94f1136335 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.757912 Jun 03 13:02:42.048185 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 20/46] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:41 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:42.175836 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-0363637b-5fde-4bda-9214-b273a71d8d53 req-3c579931-30ea-4b96-9ae4-94851473b867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e28701a-6711-4717-8c87-f0d3ea8058dd", "tag": "ff9d5f88-c72e-4e8d-a891-5c0044136c8a"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:02:42.191392 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-0363637b-5fde-4bda-9214-b273a71d8d53 req-3c579931-30ea-4b96-9ae4-94851473b867 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:42.193599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-0363637b-5fde-4bda-9214-b273a71d8d53 req-3c579931-30ea-4b96-9ae4-94851473b867 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:42.223174 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-0363637b-5fde-4bda-9214-b273a71d8d53 req-3c579931-30ea-4b96-9ae4-94851473b867 service nova] Creating event network-changed:ff9d5f88-c72e-4e8d-a891-5c0044136c8a for instance 0e28701a-6711-4717-8c87-f0d3ea8058dd on hv-cinder-77954 Jun 03 13:02:42.239331 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-0363637b-5fde-4bda-9214-b273a71d8d53 req-3c579931-30ea-4b96-9ae4-94851473b867 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067883 Jun 03 13:02:42.241565 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 27/47] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:02:42.824588 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1306791509", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d6f325b-d3a4-43a7-8d89-d0ffbb50df9b"}], "security_groups": [{"name": "tempest-securitygroup--37099209"}], "key_name": "tempest-keypair-897276757", "user_data": "}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:02:42.974725 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] validate_networks() for [('6d6f325b-d3a4-43a7-8d89-d0ffbb50df9b', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:02:43.013231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7ea0dfb5-5b4f-47f4-9e85-aa73364d3c49 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:43.014617 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7ea0dfb5-5b4f-47f4-9e85-aa73364d3c49 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:43.024605 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7ea0dfb5-5b4f-47f4-9e85-aa73364d3c49 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:43.026538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7ea0dfb5-5b4f-47f4-9e85-aa73364d3c49 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:43.028103 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7ea0dfb5-5b4f-47f4-9e85-aa73364d3c49 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:43.028556 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7ea0dfb5-5b4f-47f4-9e85-aa73364d3c49 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:43.275904 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7ea0dfb5-5b4f-47f4-9e85-aa73364d3c49 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:43.299455 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7ea0dfb5-5b4f-47f4-9e85-aa73364d3c49 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.290634 Jun 03 13:02:43.300356 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 28/48] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:43 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:43.305005 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-015d6901-edb2-4b70-bb13-8b3f4539c4c6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:43.305601 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-015d6901-edb2-4b70-bb13-8b3f4539c4c6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:43.311788 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-015d6901-edb2-4b70-bb13-8b3f4539c4c6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:43.312240 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-015d6901-edb2-4b70-bb13-8b3f4539c4c6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:43.313039 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-015d6901-edb2-4b70-bb13-8b3f4539c4c6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:43.313467 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-015d6901-edb2-4b70-bb13-8b3f4539c4c6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:43.550753 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-015d6901-edb2-4b70-bb13-8b3f4539c4c6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:43.562032 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-015d6901-edb2-4b70-bb13-8b3f4539c4c6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.260484 Jun 03 13:02:43.562925 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 29/49] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:43 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:43.577656 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:02:43.578146 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:02:43.578611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:02:43.579334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:02:43.579631 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:02:43.589339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:43.589984 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:43.591101 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:43.593212 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:43.617064 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:02:43.621212 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for user f2217b3c134d453fbdcb14853eed4e3b and project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:02:43.635377 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:02:43.637796 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:02:43.689680 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9b8477dd-29a3-4b2c-bfef-84a132a6eeaa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.870546 Jun 03 13:02:43.694462 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 21/50] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:02:42 2022] POST /compute/v2.1/servers => generated 400 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:02:43.701460 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2cbba7c4-f682-4eea-a69c-b1e07615f98f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:43.702573 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2cbba7c4-f682-4eea-a69c-b1e07615f98f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:43.784655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2cbba7c4-f682-4eea-a69c-b1e07615f98f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:43.791680 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2cbba7c4-f682-4eea-a69c-b1e07615f98f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1241 microversion: 2.1 time: 0.094461 Jun 03 13:02:43.798683 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 30/51] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:43 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:44.323864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-77aff164-1f81-4d15-92b7-054737e3b7f6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:44.324568 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-77aff164-1f81-4d15-92b7-054737e3b7f6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:44.340958 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-77aff164-1f81-4d15-92b7-054737e3b7f6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:44.342341 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-77aff164-1f81-4d15-92b7-054737e3b7f6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:44.344394 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-77aff164-1f81-4d15-92b7-054737e3b7f6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:44.344845 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-77aff164-1f81-4d15-92b7-054737e3b7f6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:44.528357 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-77aff164-1f81-4d15-92b7-054737e3b7f6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:44.554029 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-77aff164-1f81-4d15-92b7-054737e3b7f6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.241477 Jun 03 13:02:44.555300 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 22/52] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:44 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:44.581800 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-322bb63b-c968-4fb8-80a7-6798e2f0fa3d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:44.582450 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-322bb63b-c968-4fb8-80a7-6798e2f0fa3d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:44.589043 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-322bb63b-c968-4fb8-80a7-6798e2f0fa3d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:44.589720 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-322bb63b-c968-4fb8-80a7-6798e2f0fa3d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:44.590759 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-322bb63b-c968-4fb8-80a7-6798e2f0fa3d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:44.591273 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-322bb63b-c968-4fb8-80a7-6798e2f0fa3d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:44.781931 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-322bb63b-c968-4fb8-80a7-6798e2f0fa3d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:44.792859 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-322bb63b-c968-4fb8-80a7-6798e2f0fa3d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.215122 Jun 03 13:02:44.793497 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 31/53] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:44 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:44.816353 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8d73573b-2979-427a-9bd3-66b3eb91c79e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:44.816995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8d73573b-2979-427a-9bd3-66b3eb91c79e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:44.819044 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=9 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:44.824313 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d73573b-2979-427a-9bd3-66b3eb91c79e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:44.824767 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d73573b-2979-427a-9bd3-66b3eb91c79e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:44.825736 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d73573b-2979-427a-9bd3-66b3eb91c79e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:44.826196 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d73573b-2979-427a-9bd3-66b3eb91c79e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:44.833927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=65 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:44.921038 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8d73573b-2979-427a-9bd3-66b3eb91c79e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:44.936602 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8d73573b-2979-427a-9bd3-66b3eb91c79e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1245 microversion: 2.1 time: 0.124277 Jun 03 13:02:44.938926 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 23/54] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:44 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:45.571373 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0fa2d27c-2f07-430a-b344-fedad9b49203 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:45.571987 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0fa2d27c-2f07-430a-b344-fedad9b49203 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:45.580006 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fa2d27c-2f07-430a-b344-fedad9b49203 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:45.580464 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fa2d27c-2f07-430a-b344-fedad9b49203 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:45.581252 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fa2d27c-2f07-430a-b344-fedad9b49203 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:45.581689 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0fa2d27c-2f07-430a-b344-fedad9b49203 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:45.755111 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0fa2d27c-2f07-430a-b344-fedad9b49203 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:45.758159 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=91 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:45.776483 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0fa2d27c-2f07-430a-b344-fedad9b49203 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.208668 Jun 03 13:02:45.777712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 32/55] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:45 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:45.809191 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2aecb3ff-7fa6-45a9-8d70-284bd40bed04 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:45.811036 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2aecb3ff-7fa6-45a9-8d70-284bd40bed04 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:45.819046 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2aecb3ff-7fa6-45a9-8d70-284bd40bed04 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:45.819862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2aecb3ff-7fa6-45a9-8d70-284bd40bed04 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:45.820888 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2aecb3ff-7fa6-45a9-8d70-284bd40bed04 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:45.821625 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2aecb3ff-7fa6-45a9-8d70-284bd40bed04 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:45.955985 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8708d00e-a5f3-4657-881c-81d0a07c0d8e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:45.958092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8708d00e-a5f3-4657-881c-81d0a07c0d8e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:45.969890 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:45.977776 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8708d00e-a5f3-4657-881c-81d0a07c0d8e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:45.978248 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8708d00e-a5f3-4657-881c-81d0a07c0d8e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:45.979206 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8708d00e-a5f3-4657-881c-81d0a07c0d8e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:45.979972 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8708d00e-a5f3-4657-881c-81d0a07c0d8e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:46.000865 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2aecb3ff-7fa6-45a9-8d70-284bd40bed04 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:46.009650 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2aecb3ff-7fa6-45a9-8d70-284bd40bed04 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.204657 Jun 03 13:02:46.010450 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 24/56] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:45 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:46.056317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8708d00e-a5f3-4657-881c-81d0a07c0d8e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:46.065022 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8708d00e-a5f3-4657-881c-81d0a07c0d8e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1245 microversion: 2.1 time: 0.114599 Jun 03 13:02:46.065844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 33/57] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:45 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1245 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:46.793477 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f9eb9177-503f-49e5-be67-b7affc633796 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:46.794231 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f9eb9177-503f-49e5-be67-b7affc633796 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:46.803577 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f9eb9177-503f-49e5-be67-b7affc633796 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:46.804025 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f9eb9177-503f-49e5-be67-b7affc633796 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:46.804811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f9eb9177-503f-49e5-be67-b7affc633796 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:46.805240 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f9eb9177-503f-49e5-be67-b7affc633796 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:46.969097 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f9eb9177-503f-49e5-be67-b7affc633796 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:46.978580 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f9eb9177-503f-49e5-be67-b7affc633796 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.189078 Jun 03 13:02:46.979170 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 25/58] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:46 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:47.028905 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a4272ab6-15e2-45db-b868-3c52016e1447 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:47.030035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a4272ab6-15e2-45db-b868-3c52016e1447 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:47.036819 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4272ab6-15e2-45db-b868-3c52016e1447 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:47.037261 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4272ab6-15e2-45db-b868-3c52016e1447 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:47.038257 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4272ab6-15e2-45db-b868-3c52016e1447 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:47.038837 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a4272ab6-15e2-45db-b868-3c52016e1447 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:47.082785 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-26243b48-19e1-4457-a940-f0dea7f14075 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:47.083679 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-26243b48-19e1-4457-a940-f0dea7f14075 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:47.090664 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26243b48-19e1-4457-a940-f0dea7f14075 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:47.091193 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26243b48-19e1-4457-a940-f0dea7f14075 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:47.092042 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26243b48-19e1-4457-a940-f0dea7f14075 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:47.092678 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26243b48-19e1-4457-a940-f0dea7f14075 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:47.174278 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-26243b48-19e1-4457-a940-f0dea7f14075 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:47.188373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-26243b48-19e1-4457-a940-f0dea7f14075 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1245 microversion: 2.1 time: 0.109248 Jun 03 13:02:47.196798 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 26/59] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:47 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:47.209121 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a4272ab6-15e2-45db-b868-3c52016e1447 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:47.217313 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a4272ab6-15e2-45db-b868-3c52016e1447 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.192551 Jun 03 13:02:47.217955 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 34/60] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:47 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:47.996056 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3b26fdf8-f681-4044-a3ca-9ad009bc7cb9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:47.997215 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3b26fdf8-f681-4044-a3ca-9ad009bc7cb9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:48.010333 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b26fdf8-f681-4044-a3ca-9ad009bc7cb9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:48.010785 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b26fdf8-f681-4044-a3ca-9ad009bc7cb9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:48.011557 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b26fdf8-f681-4044-a3ca-9ad009bc7cb9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:48.011989 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b26fdf8-f681-4044-a3ca-9ad009bc7cb9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:48.143947 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3b26fdf8-f681-4044-a3ca-9ad009bc7cb9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:48.151442 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3b26fdf8-f681-4044-a3ca-9ad009bc7cb9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.159319 Jun 03 13:02:48.152001 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 27/61] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:47 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:48.205729 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b006c121-bdad-437a-a2a0-6f2ed9f523f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:48.206799 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b006c121-bdad-437a-a2a0-6f2ed9f523f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:48.213138 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b006c121-bdad-437a-a2a0-6f2ed9f523f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:48.213743 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b006c121-bdad-437a-a2a0-6f2ed9f523f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:48.214548 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b006c121-bdad-437a-a2a0-6f2ed9f523f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:48.214977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b006c121-bdad-437a-a2a0-6f2ed9f523f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:48.235466 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-38718799-1945-408a-b4e0-fae62730d6a1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:48.236178 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-38718799-1945-408a-b4e0-fae62730d6a1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:48.243668 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38718799-1945-408a-b4e0-fae62730d6a1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:48.244134 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38718799-1945-408a-b4e0-fae62730d6a1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:48.244898 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38718799-1945-408a-b4e0-fae62730d6a1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:48.245397 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38718799-1945-408a-b4e0-fae62730d6a1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:48.287653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b006c121-bdad-437a-a2a0-6f2ed9f523f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:48.295304 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b006c121-bdad-437a-a2a0-6f2ed9f523f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1245 microversion: 2.1 time: 0.094305 Jun 03 13:02:48.295889 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 35/62] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:48 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:48.394272 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-38718799-1945-408a-b4e0-fae62730d6a1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:48.401824 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-38718799-1945-408a-b4e0-fae62730d6a1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.171639 Jun 03 13:02:48.402436 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 28/63] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:48 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:49.170095 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5aa371a0-a3b7-4275-8233-72b881664cbb tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:49.170899 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5aa371a0-a3b7-4275-8233-72b881664cbb tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:49.176161 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:49.195441 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5aa371a0-a3b7-4275-8233-72b881664cbb tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:49.198498 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5aa371a0-a3b7-4275-8233-72b881664cbb tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:49.199689 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5aa371a0-a3b7-4275-8233-72b881664cbb tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:49.204866 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5aa371a0-a3b7-4275-8233-72b881664cbb tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:49.314026 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-69d43cf9-e2bf-4dbb-94be-1d2d76a450d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:49.314686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-69d43cf9-e2bf-4dbb-94be-1d2d76a450d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:49.320966 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-69d43cf9-e2bf-4dbb-94be-1d2d76a450d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:49.321668 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-69d43cf9-e2bf-4dbb-94be-1d2d76a450d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:49.322701 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-69d43cf9-e2bf-4dbb-94be-1d2d76a450d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:49.323282 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-69d43cf9-e2bf-4dbb-94be-1d2d76a450d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:49.495715 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-69d43cf9-e2bf-4dbb-94be-1d2d76a450d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:49.509866 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-69d43cf9-e2bf-4dbb-94be-1d2d76a450d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1293 microversion: 2.1 time: 0.196396 Jun 03 13:02:49.522069 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 29/64] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:49 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1293 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:49.528225 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-90283719-e225-4b40-95c5-837bfa8e8223 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:49.529238 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-90283719-e225-4b40-95c5-837bfa8e8223 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:49.552971 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90283719-e225-4b40-95c5-837bfa8e8223 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:49.554011 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90283719-e225-4b40-95c5-837bfa8e8223 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:49.555533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90283719-e225-4b40-95c5-837bfa8e8223 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:49.556127 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90283719-e225-4b40-95c5-837bfa8e8223 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:49.889002 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5aa371a0-a3b7-4275-8233-72b881664cbb tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:49.906792 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5aa371a0-a3b7-4275-8233-72b881664cbb tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.738017 Jun 03 13:02:49.909758 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 36/65] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:49 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:50.036237 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-90283719-e225-4b40-95c5-837bfa8e8223 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:50.046349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-90283719-e225-4b40-95c5-837bfa8e8223 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.522721 Jun 03 13:02:50.047096 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 30/66] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:49 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:50.529654 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fc28f7b8-3742-4e87-87a7-449a095e3ef7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:50.531950 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fc28f7b8-3742-4e87-87a7-449a095e3ef7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:50.542282 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc28f7b8-3742-4e87-87a7-449a095e3ef7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:50.543033 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc28f7b8-3742-4e87-87a7-449a095e3ef7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:50.544037 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc28f7b8-3742-4e87-87a7-449a095e3ef7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:50.545262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc28f7b8-3742-4e87-87a7-449a095e3ef7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:50.657651 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fc28f7b8-3742-4e87-87a7-449a095e3ef7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:50.678541 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fc28f7b8-3742-4e87-87a7-449a095e3ef7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1299 microversion: 2.1 time: 0.154328 Jun 03 13:02:50.680562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 37/67] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:50 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:50.927246 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3bd4c41a-5e84-46b2-8aec-2906c92e1a07 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:50.927849 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3bd4c41a-5e84-46b2-8aec-2906c92e1a07 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:50.936133 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3bd4c41a-5e84-46b2-8aec-2906c92e1a07 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:50.937189 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3bd4c41a-5e84-46b2-8aec-2906c92e1a07 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:50.938191 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3bd4c41a-5e84-46b2-8aec-2906c92e1a07 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:50.938732 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3bd4c41a-5e84-46b2-8aec-2906c92e1a07 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:51.064764 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-32155b46-7cbd-4f39-921a-3c748c2467f4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:51.065425 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-32155b46-7cbd-4f39-921a-3c748c2467f4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:51.077087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32155b46-7cbd-4f39-921a-3c748c2467f4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:51.078269 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32155b46-7cbd-4f39-921a-3c748c2467f4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:51.079583 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32155b46-7cbd-4f39-921a-3c748c2467f4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:51.080183 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-32155b46-7cbd-4f39-921a-3c748c2467f4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:51.215093 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3bd4c41a-5e84-46b2-8aec-2906c92e1a07 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:51.226757 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3bd4c41a-5e84-46b2-8aec-2906c92e1a07 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.304056 Jun 03 13:02:51.228191 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 31/68] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:50 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:51.306294 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-32155b46-7cbd-4f39-921a-3c748c2467f4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:51.316075 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-32155b46-7cbd-4f39-921a-3c748c2467f4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.254918 Jun 03 13:02:51.317211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 38/69] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:51 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:51.697103 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9a911ee2-2f46-4fe8-8113-583ad491771b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:51.697704 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9a911ee2-2f46-4fe8-8113-583ad491771b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:51.704105 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a911ee2-2f46-4fe8-8113-583ad491771b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:51.704758 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a911ee2-2f46-4fe8-8113-583ad491771b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:51.705547 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a911ee2-2f46-4fe8-8113-583ad491771b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:51.705970 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a911ee2-2f46-4fe8-8113-583ad491771b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:51.877366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9a911ee2-2f46-4fe8-8113-583ad491771b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:51.886296 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9a911ee2-2f46-4fe8-8113-583ad491771b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.193144 Jun 03 13:02:51.886885 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 32/70] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:51 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:52.244701 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1ca24dc4-78c0-4649-b6b2-3923158d5b42 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:52.245310 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1ca24dc4-78c0-4649-b6b2-3923158d5b42 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:52.251885 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1ca24dc4-78c0-4649-b6b2-3923158d5b42 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:52.252344 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1ca24dc4-78c0-4649-b6b2-3923158d5b42 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:52.253129 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1ca24dc4-78c0-4649-b6b2-3923158d5b42 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:52.253544 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1ca24dc4-78c0-4649-b6b2-3923158d5b42 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:52.341752 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-587f56c9-cfb6-4992-a263-c2ce0366acce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:52.342473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-587f56c9-cfb6-4992-a263-c2ce0366acce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:52.365546 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-587f56c9-cfb6-4992-a263-c2ce0366acce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:52.366274 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-587f56c9-cfb6-4992-a263-c2ce0366acce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:52.367072 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-587f56c9-cfb6-4992-a263-c2ce0366acce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:52.368338 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-587f56c9-cfb6-4992-a263-c2ce0366acce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:52.427635 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1ca24dc4-78c0-4649-b6b2-3923158d5b42 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:52.435689 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1ca24dc4-78c0-4649-b6b2-3923158d5b42 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.195348 Jun 03 13:02:52.436268 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 39/71] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:52 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:52.518571 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-587f56c9-cfb6-4992-a263-c2ce0366acce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:52.526386 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-587f56c9-cfb6-4992-a263-c2ce0366acce tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.196735 Jun 03 13:02:52.526963 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 33/72] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:52 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:52.903530 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ff1a28a6-a5a3-4d1a-b895-c8efa3913111 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:52.904402 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ff1a28a6-a5a3-4d1a-b895-c8efa3913111 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:52.910847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff1a28a6-a5a3-4d1a-b895-c8efa3913111 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:52.911305 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff1a28a6-a5a3-4d1a-b895-c8efa3913111 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:52.912077 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff1a28a6-a5a3-4d1a-b895-c8efa3913111 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:52.912513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff1a28a6-a5a3-4d1a-b895-c8efa3913111 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:53.064696 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff1a28a6-a5a3-4d1a-b895-c8efa3913111 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:53.073365 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ff1a28a6-a5a3-4d1a-b895-c8efa3913111 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.173926 Jun 03 13:02:53.073938 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 40/73] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:52 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:53.081126 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-e7355633-95ca-4a6d-b9d8-3071f54399a8 req-65e01315-edb2-4a04-bbd0-5aa760eb57bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730b6a27-293e-4481-8a66-c4b15dccceeb", "name": "network-vif-plugged", "status": "completed", "tag": "6df05199-0112-4ee8-a950-61d4404cd566"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:02:53.089481 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-e7355633-95ca-4a6d-b9d8-3071f54399a8 req-65e01315-edb2-4a04-bbd0-5aa760eb57bc service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:53.089951 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-e7355633-95ca-4a6d-b9d8-3071f54399a8 req-65e01315-edb2-4a04-bbd0-5aa760eb57bc service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:53.100899 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-e7355633-95ca-4a6d-b9d8-3071f54399a8 req-65e01315-edb2-4a04-bbd0-5aa760eb57bc service nova] Creating event network-vif-plugged:6df05199-0112-4ee8-a950-61d4404cd566 for instance 730b6a27-293e-4481-8a66-c4b15dccceeb on hv-cinder-77954 Jun 03 13:02:53.105958 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-e7355633-95ca-4a6d-b9d8-3071f54399a8 req-65e01315-edb2-4a04-bbd0-5aa760eb57bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180324 Jun 03 13:02:53.106586 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 34/74] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:02:53.452717 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-09c21201-20a9-471d-a100-eb897449aeec tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:53.453967 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-09c21201-20a9-471d-a100-eb897449aeec tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:53.460462 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09c21201-20a9-471d-a100-eb897449aeec tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:53.461136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09c21201-20a9-471d-a100-eb897449aeec tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:53.461913 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09c21201-20a9-471d-a100-eb897449aeec tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:53.462379 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-09c21201-20a9-471d-a100-eb897449aeec tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:53.550053 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5af0fbe9-209d-4bf2-9f7b-623245a20c82 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:53.550767 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5af0fbe9-209d-4bf2-9f7b-623245a20c82 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:53.557579 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5af0fbe9-209d-4bf2-9f7b-623245a20c82 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:53.558023 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5af0fbe9-209d-4bf2-9f7b-623245a20c82 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:53.558848 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5af0fbe9-209d-4bf2-9f7b-623245a20c82 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:53.559270 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5af0fbe9-209d-4bf2-9f7b-623245a20c82 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:53.606644 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=4 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.630459 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:53.643667 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-09c21201-20a9-471d-a100-eb897449aeec tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:53.652099 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-09c21201-20a9-471d-a100-eb897449aeec tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.203172 Jun 03 13:02:53.653028 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 41/75] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:53 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:53.704942 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5af0fbe9-209d-4bf2-9f7b-623245a20c82 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:53.712476 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5af0fbe9-209d-4bf2-9f7b-623245a20c82 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.167541 Jun 03 13:02:53.713048 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 35/76] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:53 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:54.092152 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-74cc48e4-2e57-4164-b31c-e34a4f39f30b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:54.093013 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-74cc48e4-2e57-4164-b31c-e34a4f39f30b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:54.095647 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=18 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:54.101744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74cc48e4-2e57-4164-b31c-e34a4f39f30b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:54.102224 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74cc48e4-2e57-4164-b31c-e34a4f39f30b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:54.103003 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74cc48e4-2e57-4164-b31c-e34a4f39f30b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:54.103440 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74cc48e4-2e57-4164-b31c-e34a4f39f30b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:54.251488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-74cc48e4-2e57-4164-b31c-e34a4f39f30b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:54.258910 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-74cc48e4-2e57-4164-b31c-e34a4f39f30b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.171724 Jun 03 13:02:54.259486 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 42/77] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:54 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:54.670151 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-616e9848-2dd0-4591-bb64-c7083d1e72bd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:54.670876 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-616e9848-2dd0-4591-bb64-c7083d1e72bd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:54.678289 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-616e9848-2dd0-4591-bb64-c7083d1e72bd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:54.678674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-616e9848-2dd0-4591-bb64-c7083d1e72bd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:54.679444 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-616e9848-2dd0-4591-bb64-c7083d1e72bd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:54.679882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-616e9848-2dd0-4591-bb64-c7083d1e72bd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:54.730717 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-597d25bb-2d50-4195-99ab-5594c0c2f519 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:54.731311 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-597d25bb-2d50-4195-99ab-5594c0c2f519 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:54.738099 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-597d25bb-2d50-4195-99ab-5594c0c2f519 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:54.738584 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-597d25bb-2d50-4195-99ab-5594c0c2f519 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:54.739363 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-597d25bb-2d50-4195-99ab-5594c0c2f519 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:54.739805 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-597d25bb-2d50-4195-99ab-5594c0c2f519 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:54.866597 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-616e9848-2dd0-4591-bb64-c7083d1e72bd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:54.874748 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-616e9848-2dd0-4591-bb64-c7083d1e72bd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.208930 Jun 03 13:02:54.875343 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 36/78] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:54 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:54.897887 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-597d25bb-2d50-4195-99ab-5594c0c2f519 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:54.906388 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-597d25bb-2d50-4195-99ab-5594c0c2f519 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.180329 Jun 03 13:02:54.906996 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 43/79] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:54 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:02:55.278463 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d1f90cee-d1ac-4359-b245-49a1a81e7d22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:55.279422 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d1f90cee-d1ac-4359-b245-49a1a81e7d22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:55.286987 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1f90cee-d1ac-4359-b245-49a1a81e7d22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:55.287431 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1f90cee-d1ac-4359-b245-49a1a81e7d22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:55.288180 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1f90cee-d1ac-4359-b245-49a1a81e7d22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:55.288598 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d1f90cee-d1ac-4359-b245-49a1a81e7d22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:55.424342 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d1f90cee-d1ac-4359-b245-49a1a81e7d22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:55.432341 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d1f90cee-d1ac-4359-b245-49a1a81e7d22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.159189 Jun 03 13:02:55.432909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 37/80] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:55 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:55.894581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-579c6d15-bb56-4185-8c17-bc8680ff9f29 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:55.895328 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-579c6d15-bb56-4185-8c17-bc8680ff9f29 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:55.903862 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-579c6d15-bb56-4185-8c17-bc8680ff9f29 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:55.904453 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-579c6d15-bb56-4185-8c17-bc8680ff9f29 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:55.905505 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-579c6d15-bb56-4185-8c17-bc8680ff9f29 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:55.906081 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-579c6d15-bb56-4185-8c17-bc8680ff9f29 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:55.923652 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8e64601f-91d1-4d49-a766-686bccaac9ed tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:55.924263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8e64601f-91d1-4d49-a766-686bccaac9ed tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:55.930946 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e64601f-91d1-4d49-a766-686bccaac9ed tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:55.931398 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e64601f-91d1-4d49-a766-686bccaac9ed tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:55.932267 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e64601f-91d1-4d49-a766-686bccaac9ed tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:55.932700 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e64601f-91d1-4d49-a766-686bccaac9ed tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:56.105617 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-579c6d15-bb56-4185-8c17-bc8680ff9f29 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:56.113168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8e64601f-91d1-4d49-a766-686bccaac9ed tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:56.116230 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-579c6d15-bb56-4185-8c17-bc8680ff9f29 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.226999 Jun 03 13:02:56.117026 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 44/81] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:55 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:56.121307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8e64601f-91d1-4d49-a766-686bccaac9ed tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.201487 Jun 03 13:02:56.121858 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 38/82] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:55 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:56.448789 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2e5910c6-02d5-40d8-8f3b-e8f3dfc776e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:56.449414 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2e5910c6-02d5-40d8-8f3b-e8f3dfc776e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:56.455917 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2e5910c6-02d5-40d8-8f3b-e8f3dfc776e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:56.456393 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2e5910c6-02d5-40d8-8f3b-e8f3dfc776e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:56.457254 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2e5910c6-02d5-40d8-8f3b-e8f3dfc776e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:56.457899 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2e5910c6-02d5-40d8-8f3b-e8f3dfc776e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:56.606069 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2e5910c6-02d5-40d8-8f3b-e8f3dfc776e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:56.615081 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2e5910c6-02d5-40d8-8f3b-e8f3dfc776e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.170161 Jun 03 13:02:56.615839 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 45/83] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:56 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:57.137486 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f38139ed-6061-47b2-a841-c9b211025384 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:57.138515 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f38139ed-6061-47b2-a841-c9b211025384 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:57.141770 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b1968efd-995f-43a5-a9c3-455419c5fb2f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:57.142451 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b1968efd-995f-43a5-a9c3-455419c5fb2f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:57.146253 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f38139ed-6061-47b2-a841-c9b211025384 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:57.146701 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f38139ed-6061-47b2-a841-c9b211025384 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:57.147472 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f38139ed-6061-47b2-a841-c9b211025384 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:57.147903 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f38139ed-6061-47b2-a841-c9b211025384 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:57.148825 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1968efd-995f-43a5-a9c3-455419c5fb2f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:57.149279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1968efd-995f-43a5-a9c3-455419c5fb2f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:57.150061 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1968efd-995f-43a5-a9c3-455419c5fb2f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:57.150534 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b1968efd-995f-43a5-a9c3-455419c5fb2f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:57.342932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f38139ed-6061-47b2-a841-c9b211025384 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:57.346953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b1968efd-995f-43a5-a9c3-455419c5fb2f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:57.351376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f38139ed-6061-47b2-a841-c9b211025384 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.220504 Jun 03 13:02:57.352044 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 39/84] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:57 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:57.354726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b1968efd-995f-43a5-a9c3-455419c5fb2f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.219471 Jun 03 13:02:57.355328 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 46/85] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:57 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:57.632229 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-530a6e22-431c-4445-ba7c-e0a8cc5e42fa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:57.632836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-530a6e22-431c-4445-ba7c-e0a8cc5e42fa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:57.639142 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-530a6e22-431c-4445-ba7c-e0a8cc5e42fa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:57.639590 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-530a6e22-431c-4445-ba7c-e0a8cc5e42fa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:57.640351 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-530a6e22-431c-4445-ba7c-e0a8cc5e42fa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:57.640843 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-530a6e22-431c-4445-ba7c-e0a8cc5e42fa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:57.655731 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:57.771745 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-530a6e22-431c-4445-ba7c-e0a8cc5e42fa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:57.779904 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-530a6e22-431c-4445-ba7c-e0a8cc5e42fa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.151523 Jun 03 13:02:57.780481 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 40/86] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:57 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:58.369123 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b497eed8-0c2a-4229-8893-fcb97fcfb86f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:58.369734 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b497eed8-0c2a-4229-8893-fcb97fcfb86f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:58.373241 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-baf3c5eb-9a62-4d99-a191-d9978d09d396 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:58.373851 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-baf3c5eb-9a62-4d99-a191-d9978d09d396 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:58.376532 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b497eed8-0c2a-4229-8893-fcb97fcfb86f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:58.376985 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b497eed8-0c2a-4229-8893-fcb97fcfb86f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:58.377911 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b497eed8-0c2a-4229-8893-fcb97fcfb86f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:58.378422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b497eed8-0c2a-4229-8893-fcb97fcfb86f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:58.382498 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-baf3c5eb-9a62-4d99-a191-d9978d09d396 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:58.382943 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-baf3c5eb-9a62-4d99-a191-d9978d09d396 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:58.383728 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-baf3c5eb-9a62-4d99-a191-d9978d09d396 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:58.384159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-baf3c5eb-9a62-4d99-a191-d9978d09d396 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:58.595768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b497eed8-0c2a-4229-8893-fcb97fcfb86f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:58.598897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-baf3c5eb-9a62-4d99-a191-d9978d09d396 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:58.604670 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b497eed8-0c2a-4229-8893-fcb97fcfb86f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.239502 Jun 03 13:02:58.605244 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 47/87] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:58 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:58.607157 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-baf3c5eb-9a62-4d99-a191-d9978d09d396 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.238143 Jun 03 13:02:58.608043 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 41/88] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:58 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:58.802750 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-89168f2d-62a3-46cc-850d-f4d88a988219 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:58.803246 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-89168f2d-62a3-46cc-850d-f4d88a988219 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:58.809897 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89168f2d-62a3-46cc-850d-f4d88a988219 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:58.810378 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89168f2d-62a3-46cc-850d-f4d88a988219 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:58.811162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89168f2d-62a3-46cc-850d-f4d88a988219 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:58.811604 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89168f2d-62a3-46cc-850d-f4d88a988219 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:58.956109 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-89168f2d-62a3-46cc-850d-f4d88a988219 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:58.965991 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-89168f2d-62a3-46cc-850d-f4d88a988219 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.172491 Jun 03 13:02:58.966609 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 48/89] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:58 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:59.625832 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9233069a-2f5e-4b63-a791-599d0db0aec1 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:59.627233 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9233069a-2f5e-4b63-a791-599d0db0aec1 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:59.627607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6d75ea3b-01b2-4da6-bf79-2b53f41933ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:59.628228 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6d75ea3b-01b2-4da6-bf79-2b53f41933ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:59.633342 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9233069a-2f5e-4b63-a791-599d0db0aec1 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:59.633793 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9233069a-2f5e-4b63-a791-599d0db0aec1 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:59.634602 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9233069a-2f5e-4b63-a791-599d0db0aec1 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:59.634737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d75ea3b-01b2-4da6-bf79-2b53f41933ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:59.635034 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9233069a-2f5e-4b63-a791-599d0db0aec1 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:59.635186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d75ea3b-01b2-4da6-bf79-2b53f41933ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:59.635913 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d75ea3b-01b2-4da6-bf79-2b53f41933ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:59.636349 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d75ea3b-01b2-4da6-bf79-2b53f41933ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:59.651138 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:02:59.827877 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9233069a-2f5e-4b63-a791-599d0db0aec1 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:59.835806 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6d75ea3b-01b2-4da6-bf79-2b53f41933ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:02:59.840232 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9233069a-2f5e-4b63-a791-599d0db0aec1 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.220730 Jun 03 13:02:59.841185 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 42/90] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:59 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:59.846516 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6d75ea3b-01b2-4da6-bf79-2b53f41933ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.224493 Jun 03 13:02:59.847391 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 49/91] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:59 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:02:59.987711 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-881c8f40-cffc-4004-ac5c-59c4ca460f19 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:02:59.988266 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-881c8f40-cffc-4004-ac5c-59c4ca460f19 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:02:59.994405 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-881c8f40-cffc-4004-ac5c-59c4ca460f19 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:59.994853 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-881c8f40-cffc-4004-ac5c-59c4ca460f19 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:02:59.995613 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-881c8f40-cffc-4004-ac5c-59c4ca460f19 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:02:59.996046 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-881c8f40-cffc-4004-ac5c-59c4ca460f19 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:00.129245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-881c8f40-cffc-4004-ac5c-59c4ca460f19 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:00.136878 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-881c8f40-cffc-4004-ac5c-59c4ca460f19 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.156298 Jun 03 13:03:00.137449 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 43/92] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:02:59 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:00.859973 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-abd9246c-f6a9-464f-ac86-a4c0df66dcdc tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:00.860584 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-abd9246c-f6a9-464f-ac86-a4c0df66dcdc tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:00.868218 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abd9246c-f6a9-464f-ac86-a4c0df66dcdc tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:00.868733 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abd9246c-f6a9-464f-ac86-a4c0df66dcdc tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:00.869984 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abd9246c-f6a9-464f-ac86-a4c0df66dcdc tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:00.870455 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8d80df22-88ab-43f3-b9f3-064cad6a6386 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:00.871127 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-abd9246c-f6a9-464f-ac86-a4c0df66dcdc tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:00.871228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8d80df22-88ab-43f3-b9f3-064cad6a6386 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:00.878314 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d80df22-88ab-43f3-b9f3-064cad6a6386 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:00.879014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d80df22-88ab-43f3-b9f3-064cad6a6386 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:00.880319 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d80df22-88ab-43f3-b9f3-064cad6a6386 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:00.880937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d80df22-88ab-43f3-b9f3-064cad6a6386 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:01.104580 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-abd9246c-f6a9-464f-ac86-a4c0df66dcdc tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:01.113988 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-abd9246c-f6a9-464f-ac86-a4c0df66dcdc tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.258129 Jun 03 13:03:01.126879 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 50/93] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:00 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:01.154565 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ef271801-c9ad-4802-83b4-af177b4c021e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:01.155204 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ef271801-c9ad-4802-83b4-af177b4c021e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:01.166626 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef271801-c9ad-4802-83b4-af177b4c021e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:01.167077 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef271801-c9ad-4802-83b4-af177b4c021e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:01.168052 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef271801-c9ad-4802-83b4-af177b4c021e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:01.168648 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef271801-c9ad-4802-83b4-af177b4c021e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:01.215593 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8d80df22-88ab-43f3-b9f3-064cad6a6386 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:01.226201 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8d80df22-88ab-43f3-b9f3-064cad6a6386 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.366797 Jun 03 13:03:01.242963 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 44/94] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:00 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:01.463313 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ef271801-c9ad-4802-83b4-af177b4c021e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:01.473728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ef271801-c9ad-4802-83b4-af177b4c021e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.323013 Jun 03 13:03:01.475086 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 51/95] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:01 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:02.144030 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c73ab943-8a24-46b0-937d-993dda0399bf tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:02.144656 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c73ab943-8a24-46b0-937d-993dda0399bf tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:02.151011 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c73ab943-8a24-46b0-937d-993dda0399bf tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:02.151570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c73ab943-8a24-46b0-937d-993dda0399bf tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:02.152560 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c73ab943-8a24-46b0-937d-993dda0399bf tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:02.152981 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c73ab943-8a24-46b0-937d-993dda0399bf tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:02.261661 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5954dc6e-4073-4fd5-8428-18562c3eaa84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:02.262305 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5954dc6e-4073-4fd5-8428-18562c3eaa84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:02.269080 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5954dc6e-4073-4fd5-8428-18562c3eaa84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:02.269909 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5954dc6e-4073-4fd5-8428-18562c3eaa84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:02.270734 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5954dc6e-4073-4fd5-8428-18562c3eaa84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:02.271177 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5954dc6e-4073-4fd5-8428-18562c3eaa84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:02.487156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c73ab943-8a24-46b0-937d-993dda0399bf tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:02.494850 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c73ab943-8a24-46b0-937d-993dda0399bf tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.354837 Jun 03 13:03:02.495434 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 45/96] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:02 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:02.499922 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c0aeb082-40e6-4784-a747-39dc125365f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:02.500529 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c0aeb082-40e6-4784-a747-39dc125365f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:02.506864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0aeb082-40e6-4784-a747-39dc125365f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:02.507318 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0aeb082-40e6-4784-a747-39dc125365f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:02.508320 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0aeb082-40e6-4784-a747-39dc125365f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:02.508761 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0aeb082-40e6-4784-a747-39dc125365f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:02.636193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5954dc6e-4073-4fd5-8428-18562c3eaa84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:02.647386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5954dc6e-4073-4fd5-8428-18562c3eaa84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.390679 Jun 03 13:03:02.656699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 52/97] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:02 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:02.656699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-54243efc-a793-4cea-9507-1547b9fd9875 req-5f2b8d4e-c7a1-4400-85d9-9f0930b96b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a85c3fde-c3c5-4354-9c7a-2b432bbdf77c", "tag": "58cc9c4e-cc54-49b9-8e2e-58c0ab81963a"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:03:02.665998 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-54243efc-a793-4cea-9507-1547b9fd9875 req-5f2b8d4e-c7a1-4400-85d9-9f0930b96b59 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:02.666635 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-54243efc-a793-4cea-9507-1547b9fd9875 req-5f2b8d4e-c7a1-4400-85d9-9f0930b96b59 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:02.681403 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-54243efc-a793-4cea-9507-1547b9fd9875 req-5f2b8d4e-c7a1-4400-85d9-9f0930b96b59 service nova] Creating event network-changed:58cc9c4e-cc54-49b9-8e2e-58c0ab81963a for instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c on hv-cinder-77954 Jun 03 13:03:02.692821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-54243efc-a793-4cea-9507-1547b9fd9875 req-5f2b8d4e-c7a1-4400-85d9-9f0930b96b59 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042882 Jun 03 13:03:02.694056 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 53/98] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:03:02.806343 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c0aeb082-40e6-4784-a747-39dc125365f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:02.813996 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c0aeb082-40e6-4784-a747-39dc125365f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.317536 Jun 03 13:03:02.815686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 46/99] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:02 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:03.512732 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f24f8d2-c58f-41ef-8b3e-6907b1f3b916 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:03.513651 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f24f8d2-c58f-41ef-8b3e-6907b1f3b916 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:03.520274 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f24f8d2-c58f-41ef-8b3e-6907b1f3b916 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:03.520792 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f24f8d2-c58f-41ef-8b3e-6907b1f3b916 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:03.521603 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f24f8d2-c58f-41ef-8b3e-6907b1f3b916 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:03.522035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f24f8d2-c58f-41ef-8b3e-6907b1f3b916 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:03.661511 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f24f8d2-c58f-41ef-8b3e-6907b1f3b916 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:03.664439 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-188231e1-bac8-493b-8928-d9f8b965fe80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:03.665122 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-188231e1-bac8-493b-8928-d9f8b965fe80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:03.669839 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f24f8d2-c58f-41ef-8b3e-6907b1f3b916 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.161343 Jun 03 13:03:03.670732 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 54/100] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:03 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:03.671688 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-188231e1-bac8-493b-8928-d9f8b965fe80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:03.672141 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-188231e1-bac8-493b-8928-d9f8b965fe80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:03.672927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-188231e1-bac8-493b-8928-d9f8b965fe80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:03.673363 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-188231e1-bac8-493b-8928-d9f8b965fe80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:03.813413 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-188231e1-bac8-493b-8928-d9f8b965fe80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:03.821126 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-188231e1-bac8-493b-8928-d9f8b965fe80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.160545 Jun 03 13:03:03.821684 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 47/101] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:03 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:03.831774 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3981bf25-8332-445a-9b90-9565c102f556 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:03.832397 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3981bf25-8332-445a-9b90-9565c102f556 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:03.838620 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3981bf25-8332-445a-9b90-9565c102f556 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:03.839374 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3981bf25-8332-445a-9b90-9565c102f556 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:03.840363 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3981bf25-8332-445a-9b90-9565c102f556 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:03.841003 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3981bf25-8332-445a-9b90-9565c102f556 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:03.998149 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3981bf25-8332-445a-9b90-9565c102f556 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:04.006513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3981bf25-8332-445a-9b90-9565c102f556 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.178559 Jun 03 13:03:04.007334 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 55/102] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:03 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:04.687131 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bd1c737a-ce3c-411f-95fe-12c91f70fad9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:04.687746 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bd1c737a-ce3c-411f-95fe-12c91f70fad9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:04.693971 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd1c737a-ce3c-411f-95fe-12c91f70fad9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:04.694463 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd1c737a-ce3c-411f-95fe-12c91f70fad9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:04.695227 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd1c737a-ce3c-411f-95fe-12c91f70fad9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:04.695661 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd1c737a-ce3c-411f-95fe-12c91f70fad9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:04.832552 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bd1c737a-ce3c-411f-95fe-12c91f70fad9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:04.837950 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-07eaa30c-78e4-4210-8ce7-5f2b9514f7cd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:04.838699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-07eaa30c-78e4-4210-8ce7-5f2b9514f7cd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:04.840220 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bd1c737a-ce3c-411f-95fe-12c91f70fad9 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.156998 Jun 03 13:03:04.841007 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 48/103] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:04 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:04.845095 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-07eaa30c-78e4-4210-8ce7-5f2b9514f7cd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:04.845545 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-07eaa30c-78e4-4210-8ce7-5f2b9514f7cd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:04.846357 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-07eaa30c-78e4-4210-8ce7-5f2b9514f7cd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:04.846889 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-07eaa30c-78e4-4210-8ce7-5f2b9514f7cd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:04.981663 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-07eaa30c-78e4-4210-8ce7-5f2b9514f7cd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:04.993303 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-07eaa30c-78e4-4210-8ce7-5f2b9514f7cd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.158917 Jun 03 13:03:04.994050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 56/104] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:04 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:05.023704 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-79fdb87b-4a2c-40a6-8d2e-9cbd8d03e373 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:05.024392 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-79fdb87b-4a2c-40a6-8d2e-9cbd8d03e373 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:05.030967 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79fdb87b-4a2c-40a6-8d2e-9cbd8d03e373 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:05.031522 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79fdb87b-4a2c-40a6-8d2e-9cbd8d03e373 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:05.032258 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79fdb87b-4a2c-40a6-8d2e-9cbd8d03e373 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:05.032743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79fdb87b-4a2c-40a6-8d2e-9cbd8d03e373 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:05.166942 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-79fdb87b-4a2c-40a6-8d2e-9cbd8d03e373 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:05.175121 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-79fdb87b-4a2c-40a6-8d2e-9cbd8d03e373 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.155498 Jun 03 13:03:05.175864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 49/105] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:05 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:05.858831 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-da225249-b908-434f-9cda-36d44b3b3ad5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:05.859758 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-da225249-b908-434f-9cda-36d44b3b3ad5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:05.868837 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da225249-b908-434f-9cda-36d44b3b3ad5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:05.869492 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da225249-b908-434f-9cda-36d44b3b3ad5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:05.870684 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da225249-b908-434f-9cda-36d44b3b3ad5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:05.871328 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da225249-b908-434f-9cda-36d44b3b3ad5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:06.010998 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a7171493-0d11-4fa6-8656-007969b1789a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:06.011626 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a7171493-0d11-4fa6-8656-007969b1789a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:06.018576 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7171493-0d11-4fa6-8656-007969b1789a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:06.019027 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7171493-0d11-4fa6-8656-007969b1789a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:06.019915 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7171493-0d11-4fa6-8656-007969b1789a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:06.020525 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7171493-0d11-4fa6-8656-007969b1789a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:06.216612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a7171493-0d11-4fa6-8656-007969b1789a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:06.223707 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-da225249-b908-434f-9cda-36d44b3b3ad5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:06.225547 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a7171493-0d11-4fa6-8656-007969b1789a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.218447 Jun 03 13:03:06.226142 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 50/106] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:06 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:06.230734 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-04482205-b80b-4589-93aa-ad1ab64dcb9d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:06.231345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-04482205-b80b-4589-93aa-ad1ab64dcb9d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:06.232660 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-da225249-b908-434f-9cda-36d44b3b3ad5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.379333 Jun 03 13:03:06.233418 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 57/107] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:05 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:06.243162 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04482205-b80b-4589-93aa-ad1ab64dcb9d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:06.243612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04482205-b80b-4589-93aa-ad1ab64dcb9d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:06.244409 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04482205-b80b-4589-93aa-ad1ab64dcb9d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:06.244818 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04482205-b80b-4589-93aa-ad1ab64dcb9d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:06.385453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-04482205-b80b-4589-93aa-ad1ab64dcb9d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:06.393187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-04482205-b80b-4589-93aa-ad1ab64dcb9d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.166084 Jun 03 13:03:06.393790 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 51/108] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:06 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:07.245573 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8ee3fdaf-60a1-4197-8e90-4ca7ea0d4ab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:07.246236 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8ee3fdaf-60a1-4197-8e90-4ca7ea0d4ab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:07.250489 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-89ad88a1-53ba-4ba6-9859-dc5711f1071e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:07.251168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-89ad88a1-53ba-4ba6-9859-dc5711f1071e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:07.253631 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ee3fdaf-60a1-4197-8e90-4ca7ea0d4ab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:07.254093 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ee3fdaf-60a1-4197-8e90-4ca7ea0d4ab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:07.254910 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ee3fdaf-60a1-4197-8e90-4ca7ea0d4ab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:07.255348 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ee3fdaf-60a1-4197-8e90-4ca7ea0d4ab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:07.258632 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89ad88a1-53ba-4ba6-9859-dc5711f1071e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:07.259083 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89ad88a1-53ba-4ba6-9859-dc5711f1071e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:07.259952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89ad88a1-53ba-4ba6-9859-dc5711f1071e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:07.260424 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-89ad88a1-53ba-4ba6-9859-dc5711f1071e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:07.451981 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8ee3fdaf-60a1-4197-8e90-4ca7ea0d4ab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:07.455936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-89ad88a1-53ba-4ba6-9859-dc5711f1071e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:07.461124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8ee3fdaf-60a1-4197-8e90-4ca7ea0d4ab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.220244 Jun 03 13:03:07.461752 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 58/109] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:07 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:07.463422 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-89ad88a1-53ba-4ba6-9859-dc5711f1071e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.217631 Jun 03 13:03:07.463978 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 52/110] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:07 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:07.466255 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7a411fa8-cb5c-4615-ae76-8b1708913bfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:07.466986 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7a411fa8-cb5c-4615-ae76-8b1708913bfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:07.473082 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a411fa8-cb5c-4615-ae76-8b1708913bfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:07.473529 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a411fa8-cb5c-4615-ae76-8b1708913bfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:07.474342 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a411fa8-cb5c-4615-ae76-8b1708913bfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:07.474783 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7a411fa8-cb5c-4615-ae76-8b1708913bfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:07.618980 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7a411fa8-cb5c-4615-ae76-8b1708913bfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:07.627030 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7a411fa8-cb5c-4615-ae76-8b1708913bfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.164265 Jun 03 13:03:07.627602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 59/111] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:07 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:07.921760 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-9a3c5be7-a35f-4a2f-8fe5-9cc97301f071 req-59005dd7-8318-43b2-a1ff-8cb09b9ffab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8810fcf9-5763-45c2-9e84-9a12f2fa1447", "name": "network-vif-plugged", "status": "completed", "tag": "f3140ed5-b3f5-4f50-a9f6-76f75f5506d6"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:03:07.936165 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-9a3c5be7-a35f-4a2f-8fe5-9cc97301f071 req-59005dd7-8318-43b2-a1ff-8cb09b9ffab9 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:07.943124 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-9a3c5be7-a35f-4a2f-8fe5-9cc97301f071 req-59005dd7-8318-43b2-a1ff-8cb09b9ffab9 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:07.958747 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-9a3c5be7-a35f-4a2f-8fe5-9cc97301f071 req-59005dd7-8318-43b2-a1ff-8cb09b9ffab9 service nova] Creating event network-vif-plugged:f3140ed5-b3f5-4f50-a9f6-76f75f5506d6 for instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 on hv-cinder-77954 Jun 03 13:03:07.964084 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-9a3c5be7-a35f-4a2f-8fe5-9cc97301f071 req-59005dd7-8318-43b2-a1ff-8cb09b9ffab9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047009 Jun 03 13:03:07.965071 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 53/112] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:03:08.479036 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e1ebfca3-7f2b-4382-9e19-21b1b305b0e1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:08.479765 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e1ebfca3-7f2b-4382-9e19-21b1b305b0e1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:08.481333 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7dcb04d4-9325-48d3-a8ab-13ef0d3abdc6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:08.482030 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7dcb04d4-9325-48d3-a8ab-13ef0d3abdc6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:08.492392 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7dcb04d4-9325-48d3-a8ab-13ef0d3abdc6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:08.492783 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7dcb04d4-9325-48d3-a8ab-13ef0d3abdc6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:08.494172 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e1ebfca3-7f2b-4382-9e19-21b1b305b0e1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:08.494636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e1ebfca3-7f2b-4382-9e19-21b1b305b0e1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:08.495418 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e1ebfca3-7f2b-4382-9e19-21b1b305b0e1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:08.495850 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e1ebfca3-7f2b-4382-9e19-21b1b305b0e1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:08.496594 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7dcb04d4-9325-48d3-a8ab-13ef0d3abdc6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:08.497972 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7dcb04d4-9325-48d3-a8ab-13ef0d3abdc6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:08.897861 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e1ebfca3-7f2b-4382-9e19-21b1b305b0e1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:08.905676 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e1ebfca3-7f2b-4382-9e19-21b1b305b0e1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.431226 Jun 03 13:03:08.906364 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 60/113] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:08 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:08.909555 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7dcb04d4-9325-48d3-a8ab-13ef0d3abdc6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:08.917444 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7dcb04d4-9325-48d3-a8ab-13ef0d3abdc6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.440372 Jun 03 13:03:08.919961 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-24bc0894-295e-4a54-9157-0af8457ad4fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:08.920695 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-24bc0894-295e-4a54-9157-0af8457ad4fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:08.926348 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 54/114] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:08 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:08.928892 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24bc0894-295e-4a54-9157-0af8457ad4fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:08.929414 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24bc0894-295e-4a54-9157-0af8457ad4fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:08.930307 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24bc0894-295e-4a54-9157-0af8457ad4fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:08.930746 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-24bc0894-295e-4a54-9157-0af8457ad4fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:09.102302 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-24bc0894-295e-4a54-9157-0af8457ad4fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:09.110740 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-24bc0894-295e-4a54-9157-0af8457ad4fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.194670 Jun 03 13:03:09.111562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 61/115] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:08 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:09.922760 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6a755714-09ee-487d-828a-a1932efa038a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:09.923595 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6a755714-09ee-487d-828a-a1932efa038a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:09.932865 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a755714-09ee-487d-828a-a1932efa038a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:09.933459 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a755714-09ee-487d-828a-a1932efa038a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:09.934407 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a755714-09ee-487d-828a-a1932efa038a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:09.934944 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a755714-09ee-487d-828a-a1932efa038a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:09.936409 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d7c2edc3-7f75-4c6b-a34e-17091cb81963 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:09.937054 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d7c2edc3-7f75-4c6b-a34e-17091cb81963 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:09.948438 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7c2edc3-7f75-4c6b-a34e-17091cb81963 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:09.949087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7c2edc3-7f75-4c6b-a34e-17091cb81963 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:09.949874 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7c2edc3-7f75-4c6b-a34e-17091cb81963 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:09.950334 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7c2edc3-7f75-4c6b-a34e-17091cb81963 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:10.179740 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d7c2edc3-7f75-4c6b-a34e-17091cb81963 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:10.188367 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6a755714-09ee-487d-828a-a1932efa038a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:10.188998 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d7c2edc3-7f75-4c6b-a34e-17091cb81963 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.256872 Jun 03 13:03:10.189728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 62/116] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:09 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:10.195389 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f2cfbfd9-b127-4310-81a2-2ddffe0278d9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:10.196166 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f2cfbfd9-b127-4310-81a2-2ddffe0278d9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:10.197901 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6a755714-09ee-487d-828a-a1932efa038a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.279480 Jun 03 13:03:10.198507 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 55/117] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:09 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:10.203601 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2cfbfd9-b127-4310-81a2-2ddffe0278d9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:10.204127 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2cfbfd9-b127-4310-81a2-2ddffe0278d9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:10.205025 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2cfbfd9-b127-4310-81a2-2ddffe0278d9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:10.205528 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f2cfbfd9-b127-4310-81a2-2ddffe0278d9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:10.418959 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f2cfbfd9-b127-4310-81a2-2ddffe0278d9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:10.430207 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f2cfbfd9-b127-4310-81a2-2ddffe0278d9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.239074 Jun 03 13:03:10.430916 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 63/118] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:10 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:11.206784 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e9a847fb-9452-444b-a1b4-e996286b59a6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:11.208086 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e9a847fb-9452-444b-a1b4-e996286b59a6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:11.215836 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-af46fcf4-e111-48d6-958d-3b46900cda14 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:11.217085 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-af46fcf4-e111-48d6-958d-3b46900cda14 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:11.217884 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9a847fb-9452-444b-a1b4-e996286b59a6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:11.218638 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9a847fb-9452-444b-a1b4-e996286b59a6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:11.219526 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9a847fb-9452-444b-a1b4-e996286b59a6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:11.220109 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9a847fb-9452-444b-a1b4-e996286b59a6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:11.224494 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-af46fcf4-e111-48d6-958d-3b46900cda14 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:11.225140 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-af46fcf4-e111-48d6-958d-3b46900cda14 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:11.226141 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-af46fcf4-e111-48d6-958d-3b46900cda14 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:11.226582 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-af46fcf4-e111-48d6-958d-3b46900cda14 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:11.459645 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e9a847fb-9452-444b-a1b4-e996286b59a6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:11.463910 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-af46fcf4-e111-48d6-958d-3b46900cda14 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:11.485810 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-af46fcf4-e111-48d6-958d-3b46900cda14 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.274508 Jun 03 13:03:11.485970 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e9a847fb-9452-444b-a1b4-e996286b59a6 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.284175 Jun 03 13:03:11.487111 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 64/119] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:11 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:11.493238 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f1ef9cea-e986-4468-b868-8211d3fcdd89 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:11.494188 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f1ef9cea-e986-4468-b868-8211d3fcdd89 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:11.497034 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 56/120] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:11 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:11.501113 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f1ef9cea-e986-4468-b868-8211d3fcdd89 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:11.501564 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f1ef9cea-e986-4468-b868-8211d3fcdd89 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:11.502427 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f1ef9cea-e986-4468-b868-8211d3fcdd89 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:11.502861 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f1ef9cea-e986-4468-b868-8211d3fcdd89 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:11.647855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f1ef9cea-e986-4468-b868-8211d3fcdd89 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:11.656406 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f1ef9cea-e986-4468-b868-8211d3fcdd89 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.167605 Jun 03 13:03:11.656995 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 65/121] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:11 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:12.507730 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-441ca5ef-bf34-4f9f-a3cd-7dde6c0692de tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:12.508708 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3e6e324b-a569-438b-96be-7be4d43ccc5d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:12.509812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-441ca5ef-bf34-4f9f-a3cd-7dde6c0692de tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:12.513406 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3e6e324b-a569-438b-96be-7be4d43ccc5d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:12.521170 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e6e324b-a569-438b-96be-7be4d43ccc5d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:12.521621 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e6e324b-a569-438b-96be-7be4d43ccc5d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:12.522445 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e6e324b-a569-438b-96be-7be4d43ccc5d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:12.522880 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e6e324b-a569-438b-96be-7be4d43ccc5d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:12.528351 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-441ca5ef-bf34-4f9f-a3cd-7dde6c0692de tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:12.529021 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-441ca5ef-bf34-4f9f-a3cd-7dde6c0692de tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:12.529812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-441ca5ef-bf34-4f9f-a3cd-7dde6c0692de tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:12.544459 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-441ca5ef-bf34-4f9f-a3cd-7dde6c0692de tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:12.735276 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3e6e324b-a569-438b-96be-7be4d43ccc5d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:12.738236 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:12.746901 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3e6e324b-a569-438b-96be-7be4d43ccc5d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.245783 Jun 03 13:03:12.747626 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 57/122] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:12 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:12.752204 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c0828555-52f5-4d60-a6ed-4d240e06c9c9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:12.753590 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c0828555-52f5-4d60-a6ed-4d240e06c9c9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:12.765448 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-441ca5ef-bf34-4f9f-a3cd-7dde6c0692de tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:12.765448 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:12.772118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-441ca5ef-bf34-4f9f-a3cd-7dde6c0692de tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.272957 Jun 03 13:03:12.775062 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0828555-52f5-4d60-a6ed-4d240e06c9c9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:12.775502 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0828555-52f5-4d60-a6ed-4d240e06c9c9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:12.778505 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 66/123] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:12 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:12.786058 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0828555-52f5-4d60-a6ed-4d240e06c9c9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:12.786702 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c0828555-52f5-4d60-a6ed-4d240e06c9c9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:13.084589 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c0828555-52f5-4d60-a6ed-4d240e06c9c9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:13.092406 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c0828555-52f5-4d60-a6ed-4d240e06c9c9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.343824 Jun 03 13:03:13.092972 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 58/124] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:12 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:13.764618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-01dbe3f7-ce88-4c3e-9bb1-9ca38afdac96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:13.765930 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-01dbe3f7-ce88-4c3e-9bb1-9ca38afdac96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:13.772960 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01dbe3f7-ce88-4c3e-9bb1-9ca38afdac96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:13.773593 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01dbe3f7-ce88-4c3e-9bb1-9ca38afdac96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:13.774546 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01dbe3f7-ce88-4c3e-9bb1-9ca38afdac96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:13.774986 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-01dbe3f7-ce88-4c3e-9bb1-9ca38afdac96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:13.793878 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a7aef365-1a34-4498-8e1a-46b3372efdbe tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:13.794452 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a7aef365-1a34-4498-8e1a-46b3372efdbe tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:13.800525 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7aef365-1a34-4498-8e1a-46b3372efdbe tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:13.800967 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7aef365-1a34-4498-8e1a-46b3372efdbe tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:13.801750 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7aef365-1a34-4498-8e1a-46b3372efdbe tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:13.802225 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7aef365-1a34-4498-8e1a-46b3372efdbe tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:13.978275 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-01dbe3f7-ce88-4c3e-9bb1-9ca38afdac96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:13.986947 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-01dbe3f7-ce88-4c3e-9bb1-9ca38afdac96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.226661 Jun 03 13:03:13.987549 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 67/125] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:13 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:13.996317 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a7aef365-1a34-4498-8e1a-46b3372efdbe tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:14.000920 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a7aef365-1a34-4498-8e1a-46b3372efdbe tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.211399 Jun 03 13:03:14.001484 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 59/126] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:13 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:14.109675 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-41671257-a669-4e5e-b248-7a7a14472da0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:14.110378 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-41671257-a669-4e5e-b248-7a7a14472da0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:14.118399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41671257-a669-4e5e-b248-7a7a14472da0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:14.119047 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41671257-a669-4e5e-b248-7a7a14472da0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:14.119933 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41671257-a669-4e5e-b248-7a7a14472da0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:14.120650 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41671257-a669-4e5e-b248-7a7a14472da0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:14.258641 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-41671257-a669-4e5e-b248-7a7a14472da0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:14.266677 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-41671257-a669-4e5e-b248-7a7a14472da0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.161630 Jun 03 13:03:14.267253 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 68/127] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:14 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:15.004108 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5aa8018b-15ca-46b1-9ed6-e21b48bece89 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:15.004786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5aa8018b-15ca-46b1-9ed6-e21b48bece89 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:15.006701 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=74 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:15.012292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5aa8018b-15ca-46b1-9ed6-e21b48bece89 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:15.012776 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5aa8018b-15ca-46b1-9ed6-e21b48bece89 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:15.013550 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5aa8018b-15ca-46b1-9ed6-e21b48bece89 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:15.013975 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5aa8018b-15ca-46b1-9ed6-e21b48bece89 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:15.019626 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b45a88d0-8b9e-4b07-81da-944826284279 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:15.020251 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b45a88d0-8b9e-4b07-81da-944826284279 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:15.027462 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b45a88d0-8b9e-4b07-81da-944826284279 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:15.027923 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b45a88d0-8b9e-4b07-81da-944826284279 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:15.028708 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b45a88d0-8b9e-4b07-81da-944826284279 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:15.029435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b45a88d0-8b9e-4b07-81da-944826284279 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:15.222484 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5aa8018b-15ca-46b1-9ed6-e21b48bece89 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:15.226290 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b45a88d0-8b9e-4b07-81da-944826284279 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:15.231995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5aa8018b-15ca-46b1-9ed6-e21b48bece89 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.231984 Jun 03 13:03:15.233119 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 60/128] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:14 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:15.234801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b45a88d0-8b9e-4b07-81da-944826284279 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1314 microversion: 2.1 time: 0.220477 Jun 03 13:03:15.235490 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 69/129] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:15 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:15.284718 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f027cbbc-9762-4a62-84b5-912ff6ee83d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:15.285308 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f027cbbc-9762-4a62-84b5-912ff6ee83d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:15.291466 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f027cbbc-9762-4a62-84b5-912ff6ee83d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:15.291912 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f027cbbc-9762-4a62-84b5-912ff6ee83d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:15.292674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f027cbbc-9762-4a62-84b5-912ff6ee83d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:15.293105 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f027cbbc-9762-4a62-84b5-912ff6ee83d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:15.431743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f027cbbc-9762-4a62-84b5-912ff6ee83d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:15.439547 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f027cbbc-9762-4a62-84b5-912ff6ee83d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.159086 Jun 03 13:03:15.440272 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 61/130] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:15 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:16.248935 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-15b7a032-c043-4ef2-ba7e-3801c16130a9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:16.249551 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-15b7a032-c043-4ef2-ba7e-3801c16130a9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:16.251563 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=74 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:16.252128 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a7491951-ec17-4c39-bd9a-ae336589b773 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:16.253280 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a7491951-ec17-4c39-bd9a-ae336589b773 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:16.257008 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15b7a032-c043-4ef2-ba7e-3801c16130a9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:16.257451 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15b7a032-c043-4ef2-ba7e-3801c16130a9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:16.258263 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15b7a032-c043-4ef2-ba7e-3801c16130a9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:16.258698 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-15b7a032-c043-4ef2-ba7e-3801c16130a9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:16.259535 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7491951-ec17-4c39-bd9a-ae336589b773 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:16.259989 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7491951-ec17-4c39-bd9a-ae336589b773 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:16.260765 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7491951-ec17-4c39-bd9a-ae336589b773 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:16.261200 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7491951-ec17-4c39-bd9a-ae336589b773 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:16.485318 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-15b7a032-c043-4ef2-ba7e-3801c16130a9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:16.490413 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a7491951-ec17-4c39-bd9a-ae336589b773 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:16.500466 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-15b7a032-c043-4ef2-ba7e-3801c16130a9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.255248 Jun 03 13:03:16.500672 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a7491951-ec17-4c39-bd9a-ae336589b773 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1501 microversion: 2.1 time: 0.252139 Jun 03 13:03:16.504605 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 70/131] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:16 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:16.513650 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 62/132] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:16 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1501 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:16.515225 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ec8c8270-15ab-40a5-a912-eb407de86a7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:16.515851 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ec8c8270-15ab-40a5-a912-eb407de86a7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:16.526253 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec8c8270-15ab-40a5-a912-eb407de86a7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:16.526704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec8c8270-15ab-40a5-a912-eb407de86a7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:16.527639 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec8c8270-15ab-40a5-a912-eb407de86a7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:16.528075 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec8c8270-15ab-40a5-a912-eb407de86a7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:16.741456 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-7a9de9d7-b46b-4f3b-b6f0-9fe226f92dd2 req-0e633b06-eb72-4159-b62d-3283f4bbe3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e28701a-6711-4717-8c87-f0d3ea8058dd", "name": "network-vif-plugged", "status": "completed", "tag": "ff9d5f88-c72e-4e8d-a891-5c0044136c8a"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:03:16.750811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-7a9de9d7-b46b-4f3b-b6f0-9fe226f92dd2 req-0e633b06-eb72-4159-b62d-3283f4bbe3dc service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:16.751585 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-7a9de9d7-b46b-4f3b-b6f0-9fe226f92dd2 req-0e633b06-eb72-4159-b62d-3283f4bbe3dc service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:16.765564 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-7a9de9d7-b46b-4f3b-b6f0-9fe226f92dd2 req-0e633b06-eb72-4159-b62d-3283f4bbe3dc service nova] Creating event network-vif-plugged:ff9d5f88-c72e-4e8d-a891-5c0044136c8a for instance 0e28701a-6711-4717-8c87-f0d3ea8058dd on hv-cinder-77954 Jun 03 13:03:16.771904 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-7a9de9d7-b46b-4f3b-b6f0-9fe226f92dd2 req-0e633b06-eb72-4159-b62d-3283f4bbe3dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034696 Jun 03 13:03:16.776727 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 63/133] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:03:16.927999 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ec8c8270-15ab-40a5-a912-eb407de86a7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:16.940727 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ec8c8270-15ab-40a5-a912-eb407de86a7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.434726 Jun 03 13:03:16.951965 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 71/134] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:16 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:17.525381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-76dd2b6f-ebd3-41d1-8465-7702dfbbcc95 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:17.528681 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-76dd2b6f-ebd3-41d1-8465-7702dfbbcc95 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:17.544778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-76dd2b6f-ebd3-41d1-8465-7702dfbbcc95 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:17.545230 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-76dd2b6f-ebd3-41d1-8465-7702dfbbcc95 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:17.551320 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-76dd2b6f-ebd3-41d1-8465-7702dfbbcc95 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:17.553220 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-76dd2b6f-ebd3-41d1-8465-7702dfbbcc95 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:17.856964 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-76dd2b6f-ebd3-41d1-8465-7702dfbbcc95 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:17.866193 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-76dd2b6f-ebd3-41d1-8465-7702dfbbcc95 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.347633 Jun 03 13:03:17.866630 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 64/135] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:17 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:17.959229 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-681b327c-54f0-4e0d-be28-acfd4f0c752d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:17.966304 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-681b327c-54f0-4e0d-be28-acfd4f0c752d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:17.977915 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-681b327c-54f0-4e0d-be28-acfd4f0c752d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:17.978376 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-681b327c-54f0-4e0d-be28-acfd4f0c752d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:17.979152 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-681b327c-54f0-4e0d-be28-acfd4f0c752d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:17.979579 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-681b327c-54f0-4e0d-be28-acfd4f0c752d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:18.280452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-681b327c-54f0-4e0d-be28-acfd4f0c752d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:18.296410 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-681b327c-54f0-4e0d-be28-acfd4f0c752d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.341646 Jun 03 13:03:18.296972 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 72/136] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:17 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:18.423937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-843e6ada-f4c4-48f2-b271-69c498b7796c tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71d1ffa7-f7f5-4934-90bb-befb1214ebaf"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:03:18.425326 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-843e6ada-f4c4-48f2-b271-69c498b7796c tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:18.432054 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-843e6ada-f4c4-48f2-b271-69c498b7796c tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:18.432899 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-843e6ada-f4c4-48f2-b271-69c498b7796c tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:18.433977 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-843e6ada-f4c4-48f2-b271-69c498b7796c tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:18.434645 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-843e6ada-f4c4-48f2-b271-69c498b7796c tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:18.886176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0691652d-65c7-4374-87a2-d0dbcdca00b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:18.887219 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0691652d-65c7-4374-87a2-d0dbcdca00b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:18.898951 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0691652d-65c7-4374-87a2-d0dbcdca00b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:18.899882 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0691652d-65c7-4374-87a2-d0dbcdca00b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:18.900675 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0691652d-65c7-4374-87a2-d0dbcdca00b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:18.901108 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0691652d-65c7-4374-87a2-d0dbcdca00b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:19.019196 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-843e6ada-f4c4-48f2-b271-69c498b7796c tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "POST /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.597503 Jun 03 13:03:19.029277 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 65/137] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:03:18 2022] POST /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb/os-volume_attachments => generated 194 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:03:19.087024 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0691652d-65c7-4374-87a2-d0dbcdca00b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:19.099145 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0691652d-65c7-4374-87a2-d0dbcdca00b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.220158 Jun 03 13:03:19.110680 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 73/138] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:18 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:19.320006 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c061fb50-4010-444d-80b6-a3b297808618 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:19.321658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c061fb50-4010-444d-80b6-a3b297808618 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:19.331874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c061fb50-4010-444d-80b6-a3b297808618 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:19.332773 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c061fb50-4010-444d-80b6-a3b297808618 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:19.334579 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c061fb50-4010-444d-80b6-a3b297808618 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:19.335164 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c061fb50-4010-444d-80b6-a3b297808618 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:19.543750 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c061fb50-4010-444d-80b6-a3b297808618 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:19.565513 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c061fb50-4010-444d-80b6-a3b297808618 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.252764 Jun 03 13:03:19.566215 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 66/139] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:19 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:20.117091 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5dbede1c-c2f9-490e-bdb4-65e779f914dd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:20.118278 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5dbede1c-c2f9-490e-bdb4-65e779f914dd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:20.125505 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5dbede1c-c2f9-490e-bdb4-65e779f914dd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:20.125947 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5dbede1c-c2f9-490e-bdb4-65e779f914dd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:20.126769 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5dbede1c-c2f9-490e-bdb4-65e779f914dd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:20.127197 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5dbede1c-c2f9-490e-bdb4-65e779f914dd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:20.289927 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5dbede1c-c2f9-490e-bdb4-65e779f914dd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:20.297837 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5dbede1c-c2f9-490e-bdb4-65e779f914dd tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.184936 Jun 03 13:03:20.298439 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 74/140] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:20 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:20.588347 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-04a7633b-9a02-434c-a592-aadc65756152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:20.588347 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-04a7633b-9a02-434c-a592-aadc65756152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:20.593553 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04a7633b-9a02-434c-a592-aadc65756152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:20.594003 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04a7633b-9a02-434c-a592-aadc65756152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:20.594808 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04a7633b-9a02-434c-a592-aadc65756152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:20.595241 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04a7633b-9a02-434c-a592-aadc65756152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:20.737254 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-04a7633b-9a02-434c-a592-aadc65756152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:20.748676 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-04a7633b-9a02-434c-a592-aadc65756152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.166307 Jun 03 13:03:20.749463 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 67/141] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:20 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:21.315169 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1b0a8743-b903-4c67-b9c5-b11026e6204f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:21.315768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1b0a8743-b903-4c67-b9c5-b11026e6204f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:21.322593 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b0a8743-b903-4c67-b9c5-b11026e6204f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:21.323034 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b0a8743-b903-4c67-b9c5-b11026e6204f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:21.323794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b0a8743-b903-4c67-b9c5-b11026e6204f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:21.324220 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b0a8743-b903-4c67-b9c5-b11026e6204f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:21.457908 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1b0a8743-b903-4c67-b9c5-b11026e6204f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:21.465887 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1b0a8743-b903-4c67-b9c5-b11026e6204f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.154642 Jun 03 13:03:21.466498 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 75/142] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:21 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:21.770568 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-137c7f36-8d8f-42dc-9bf9-c71e54f8c630 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:21.771245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-137c7f36-8d8f-42dc-9bf9-c71e54f8c630 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:21.779184 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-137c7f36-8d8f-42dc-9bf9-c71e54f8c630 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:21.779693 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-137c7f36-8d8f-42dc-9bf9-c71e54f8c630 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:21.780613 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-137c7f36-8d8f-42dc-9bf9-c71e54f8c630 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:21.781112 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-137c7f36-8d8f-42dc-9bf9-c71e54f8c630 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:21.921838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-137c7f36-8d8f-42dc-9bf9-c71e54f8c630 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:21.930271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-137c7f36-8d8f-42dc-9bf9-c71e54f8c630 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.166411 Jun 03 13:03:21.930843 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 68/143] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:21 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:22.482877 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e8cf7026-9876-4224-a07b-30567954acd8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:22.483506 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e8cf7026-9876-4224-a07b-30567954acd8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:22.489989 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8cf7026-9876-4224-a07b-30567954acd8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:22.490473 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8cf7026-9876-4224-a07b-30567954acd8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:22.491237 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8cf7026-9876-4224-a07b-30567954acd8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:22.491671 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e8cf7026-9876-4224-a07b-30567954acd8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:22.641979 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e8cf7026-9876-4224-a07b-30567954acd8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:22.650467 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e8cf7026-9876-4224-a07b-30567954acd8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.171693 Jun 03 13:03:22.650871 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 76/144] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:22 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:22.955913 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-71d54bb0-6612-453b-af52-9f32793aff5f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:22.956805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-71d54bb0-6612-453b-af52-9f32793aff5f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:22.968445 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-71d54bb0-6612-453b-af52-9f32793aff5f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:22.969210 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-71d54bb0-6612-453b-af52-9f32793aff5f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:22.970620 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-71d54bb0-6612-453b-af52-9f32793aff5f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:22.971364 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-71d54bb0-6612-453b-af52-9f32793aff5f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:23.108378 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-71d54bb0-6612-453b-af52-9f32793aff5f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:23.120723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-71d54bb0-6612-453b-af52-9f32793aff5f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.171381 Jun 03 13:03:23.121391 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 69/145] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:22 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:23.674341 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1b21a710-0e23-46b4-80fc-589ba93872bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:23.674945 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1b21a710-0e23-46b4-80fc-589ba93872bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:23.682404 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b21a710-0e23-46b4-80fc-589ba93872bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:23.682731 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b21a710-0e23-46b4-80fc-589ba93872bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:23.683665 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b21a710-0e23-46b4-80fc-589ba93872bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:23.684096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1b21a710-0e23-46b4-80fc-589ba93872bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:23.821726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1b21a710-0e23-46b4-80fc-589ba93872bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:23.830953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1b21a710-0e23-46b4-80fc-589ba93872bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.166189 Jun 03 13:03:23.831544 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 77/146] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:23 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:24.145132 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-09211029-1229-4da2-bbc7-be8c93bab2d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:24.146345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-09211029-1229-4da2-bbc7-be8c93bab2d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:24.157136 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09211029-1229-4da2-bbc7-be8c93bab2d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:24.157882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09211029-1229-4da2-bbc7-be8c93bab2d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:24.159205 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09211029-1229-4da2-bbc7-be8c93bab2d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:24.159930 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09211029-1229-4da2-bbc7-be8c93bab2d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:24.293582 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-09211029-1229-4da2-bbc7-be8c93bab2d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:24.301606 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-09211029-1229-4da2-bbc7-be8c93bab2d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.162806 Jun 03 13:03:24.302255 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 70/147] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:24 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:24.851160 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-638c5143-c726-4b4b-a32a-cec97cd85a68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:24.851905 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-638c5143-c726-4b4b-a32a-cec97cd85a68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:24.859701 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-638c5143-c726-4b4b-a32a-cec97cd85a68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:24.860227 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-638c5143-c726-4b4b-a32a-cec97cd85a68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:24.861130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-638c5143-c726-4b4b-a32a-cec97cd85a68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:24.861640 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-638c5143-c726-4b4b-a32a-cec97cd85a68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:25.023148 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-638c5143-c726-4b4b-a32a-cec97cd85a68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:25.030806 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-638c5143-c726-4b4b-a32a-cec97cd85a68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.185304 Jun 03 13:03:25.031380 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 78/148] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:24 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:25.320670 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-899bbb73-1fa9-4526-8aa1-c2b99e385d2f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:25.321259 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-899bbb73-1fa9-4526-8aa1-c2b99e385d2f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:25.331390 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-899bbb73-1fa9-4526-8aa1-c2b99e385d2f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:25.331999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-899bbb73-1fa9-4526-8aa1-c2b99e385d2f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:25.333012 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-899bbb73-1fa9-4526-8aa1-c2b99e385d2f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:25.333436 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-899bbb73-1fa9-4526-8aa1-c2b99e385d2f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:25.467853 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-899bbb73-1fa9-4526-8aa1-c2b99e385d2f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:25.478519 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-899bbb73-1fa9-4526-8aa1-c2b99e385d2f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.163370 Jun 03 13:03:25.486457 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 71/149] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:25 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:26.048753 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6f93820c-05d6-4aab-9079-1f23f1a63a0e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:26.049580 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6f93820c-05d6-4aab-9079-1f23f1a63a0e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:26.056397 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f93820c-05d6-4aab-9079-1f23f1a63a0e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:26.056849 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f93820c-05d6-4aab-9079-1f23f1a63a0e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:26.057670 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f93820c-05d6-4aab-9079-1f23f1a63a0e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:26.058150 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f93820c-05d6-4aab-9079-1f23f1a63a0e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:26.199334 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6f93820c-05d6-4aab-9079-1f23f1a63a0e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:26.207846 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6f93820c-05d6-4aab-9079-1f23f1a63a0e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1321 microversion: 2.1 time: 0.163166 Jun 03 13:03:26.208604 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 79/150] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:26 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:26.503257 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5977ecdd-6165-4f01-86d4-d23c30079a66 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:26.503775 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5977ecdd-6165-4f01-86d4-d23c30079a66 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:26.510500 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5977ecdd-6165-4f01-86d4-d23c30079a66 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:26.511286 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5977ecdd-6165-4f01-86d4-d23c30079a66 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:26.512066 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5977ecdd-6165-4f01-86d4-d23c30079a66 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:26.512489 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5977ecdd-6165-4f01-86d4-d23c30079a66 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:26.656374 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5977ecdd-6165-4f01-86d4-d23c30079a66 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:26.666712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5977ecdd-6165-4f01-86d4-d23c30079a66 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.167749 Jun 03 13:03:26.668527 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 72/151] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:26 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:27.225056 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e6420a95-d83b-485f-8ac0-95133d1482ad tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:27.225651 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e6420a95-d83b-485f-8ac0-95133d1482ad tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:27.232212 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6420a95-d83b-485f-8ac0-95133d1482ad tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:27.233000 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6420a95-d83b-485f-8ac0-95133d1482ad tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:27.233765 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6420a95-d83b-485f-8ac0-95133d1482ad tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:27.234229 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6420a95-d83b-485f-8ac0-95133d1482ad tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:27.374324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e6420a95-d83b-485f-8ac0-95133d1482ad tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:27.383349 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e6420a95-d83b-485f-8ac0-95133d1482ad tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1514 microversion: 2.1 time: 0.162282 Jun 03 13:03:27.384252 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 80/152] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:27 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:27.401512 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fd2cea1f-81ef-4483-8249-eab6fe5082e7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:03:27.402894 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fd2cea1f-81ef-4483-8249-eab6fe5082e7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:27.409782 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd2cea1f-81ef-4483-8249-eab6fe5082e7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:27.430769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd2cea1f-81ef-4483-8249-eab6fe5082e7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:27.432381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd2cea1f-81ef-4483-8249-eab6fe5082e7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:27.432958 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd2cea1f-81ef-4483-8249-eab6fe5082e7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:27.470733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-fd2cea1f-81ef-4483-8249-eab6fe5082e7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lazy-loading 'flavor' on Instance uuid 0e28701a-6711-4717-8c87-f0d3ea8058dd {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:03:27.512038 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:27.636712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fd2cea1f-81ef-4483-8249-eab6fe5082e7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "POST /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd/action" status: 200 len: 32 microversion: 2.1 time: 0.239488 Jun 03 13:03:27.637835 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 73/153] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:03:27 2022] POST /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:03:27.647287 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3ee4af5b-a649-4882-9a55-c90ff08f45cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:27.647905 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3ee4af5b-a649-4882-9a55-c90ff08f45cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:27.654350 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ee4af5b-a649-4882-9a55-c90ff08f45cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:27.654973 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ee4af5b-a649-4882-9a55-c90ff08f45cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:27.656144 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ee4af5b-a649-4882-9a55-c90ff08f45cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:27.657320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3ee4af5b-a649-4882-9a55-c90ff08f45cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:27.690789 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-863037c4-d4c1-4666-81dc-eba54ae8c4bd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:27.691477 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-863037c4-d4c1-4666-81dc-eba54ae8c4bd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:27.698819 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-863037c4-d4c1-4666-81dc-eba54ae8c4bd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:27.699582 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-863037c4-d4c1-4666-81dc-eba54ae8c4bd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:27.700350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-863037c4-d4c1-4666-81dc-eba54ae8c4bd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:27.700775 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-863037c4-d4c1-4666-81dc-eba54ae8c4bd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:28.100927 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3ee4af5b-a649-4882-9a55-c90ff08f45cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:28.109449 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-863037c4-d4c1-4666-81dc-eba54ae8c4bd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:28.110475 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3ee4af5b-a649-4882-9a55-c90ff08f45cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.467635 Jun 03 13:03:28.112589 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 81/154] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:27 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:28.119448 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-863037c4-d4c1-4666-81dc-eba54ae8c4bd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.432894 Jun 03 13:03:28.120283 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 74/155] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:27 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:29.129297 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-60423af3-f807-4772-ad31-583f74727790 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:29.130231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-60423af3-f807-4772-ad31-583f74727790 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:29.137037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dde8dac2-00d2-4c13-94f8-0789dcadca6b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:29.137649 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60423af3-f807-4772-ad31-583f74727790 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:29.137649 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60423af3-f807-4772-ad31-583f74727790 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:29.137806 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dde8dac2-00d2-4c13-94f8-0789dcadca6b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:29.138386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60423af3-f807-4772-ad31-583f74727790 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:29.138944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60423af3-f807-4772-ad31-583f74727790 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:29.145501 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dde8dac2-00d2-4c13-94f8-0789dcadca6b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:29.145501 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dde8dac2-00d2-4c13-94f8-0789dcadca6b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:29.146339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dde8dac2-00d2-4c13-94f8-0789dcadca6b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:29.146766 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dde8dac2-00d2-4c13-94f8-0789dcadca6b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:29.375995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dde8dac2-00d2-4c13-94f8-0789dcadca6b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:29.380278 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-60423af3-f807-4772-ad31-583f74727790 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:29.387112 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dde8dac2-00d2-4c13-94f8-0789dcadca6b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.254659 Jun 03 13:03:29.388909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 75/156] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:29 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:29.389491 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-60423af3-f807-4772-ad31-583f74727790 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.264096 Jun 03 13:03:29.390078 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 82/157] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:29 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:30.407992 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2b7f9bbb-fbb1-400c-8a56-ed614c23f6bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:30.408608 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2b7f9bbb-fbb1-400c-8a56-ed614c23f6bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:30.411009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a5a5788e-144c-4ccb-97ed-358340d47a9a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:30.412189 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a5a5788e-144c-4ccb-97ed-358340d47a9a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:30.422373 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b7f9bbb-fbb1-400c-8a56-ed614c23f6bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:30.422920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b7f9bbb-fbb1-400c-8a56-ed614c23f6bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:30.425725 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b7f9bbb-fbb1-400c-8a56-ed614c23f6bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:30.428825 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b7f9bbb-fbb1-400c-8a56-ed614c23f6bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:30.434241 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a5a5788e-144c-4ccb-97ed-358340d47a9a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:30.434781 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a5a5788e-144c-4ccb-97ed-358340d47a9a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:30.436077 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a5a5788e-144c-4ccb-97ed-358340d47a9a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:30.437162 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a5a5788e-144c-4ccb-97ed-358340d47a9a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:30.461499 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:30.753666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a5a5788e-144c-4ccb-97ed-358340d47a9a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:30.762536 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a5a5788e-144c-4ccb-97ed-358340d47a9a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.359242 Jun 03 13:03:30.763555 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 76/158] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:30 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:30.768185 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-12227390-b078-4828-9117-da571424aa9b req-707f43a7-7ab1-445d-a5cb-623cb19a3051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85c3fde-c3c5-4354-9c7a-2b432bbdf77c", "name": "network-vif-plugged", "status": "completed", "tag": "58cc9c4e-cc54-49b9-8e2e-58c0ab81963a"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:03:30.778652 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-12227390-b078-4828-9117-da571424aa9b req-707f43a7-7ab1-445d-a5cb-623cb19a3051 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:30.779994 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-12227390-b078-4828-9117-da571424aa9b req-707f43a7-7ab1-445d-a5cb-623cb19a3051 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:30.790179 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2b7f9bbb-fbb1-400c-8a56-ed614c23f6bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:30.794499 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-12227390-b078-4828-9117-da571424aa9b req-707f43a7-7ab1-445d-a5cb-623cb19a3051 service nova] Creating event network-vif-plugged:58cc9c4e-cc54-49b9-8e2e-58c0ab81963a for instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c on hv-cinder-77954 Jun 03 13:03:30.798099 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2b7f9bbb-fbb1-400c-8a56-ed614c23f6bf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.395153 Jun 03 13:03:30.800214 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-12227390-b078-4828-9117-da571424aa9b req-707f43a7-7ab1-445d-a5cb-623cb19a3051 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035194 Jun 03 13:03:30.801221 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 77/159] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:03:30.801667 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 83/160] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:30 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:31.780730 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c63a5e34-5b8b-4532-b38c-968bf2a806dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:31.781427 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c63a5e34-5b8b-4532-b38c-968bf2a806dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:31.788497 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c63a5e34-5b8b-4532-b38c-968bf2a806dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:31.789144 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c63a5e34-5b8b-4532-b38c-968bf2a806dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:31.789900 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c63a5e34-5b8b-4532-b38c-968bf2a806dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:31.790518 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c63a5e34-5b8b-4532-b38c-968bf2a806dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:31.814827 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-202c2e0b-6b1c-4d4c-9633-6f9c353e6af7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:31.815459 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-202c2e0b-6b1c-4d4c-9633-6f9c353e6af7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:31.825063 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-202c2e0b-6b1c-4d4c-9633-6f9c353e6af7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:31.825946 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-202c2e0b-6b1c-4d4c-9633-6f9c353e6af7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:31.831551 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-202c2e0b-6b1c-4d4c-9633-6f9c353e6af7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:31.833737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-202c2e0b-6b1c-4d4c-9633-6f9c353e6af7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:32.111781 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c63a5e34-5b8b-4532-b38c-968bf2a806dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:32.131964 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c63a5e34-5b8b-4532-b38c-968bf2a806dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.352751 Jun 03 13:03:32.132629 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 78/161] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:31 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:32.286719 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-202c2e0b-6b1c-4d4c-9633-6f9c353e6af7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:32.295299 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-202c2e0b-6b1c-4d4c-9633-6f9c353e6af7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.484221 Jun 03 13:03:32.299068 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 84/162] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:31 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:33.150165 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3070540c-a4a1-4323-8097-9db457dd0668 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:33.151720 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3070540c-a4a1-4323-8097-9db457dd0668 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:33.160069 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3070540c-a4a1-4323-8097-9db457dd0668 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:33.161191 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3070540c-a4a1-4323-8097-9db457dd0668 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:33.163553 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3070540c-a4a1-4323-8097-9db457dd0668 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:33.164220 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3070540c-a4a1-4323-8097-9db457dd0668 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:33.316058 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a22a474d-7c87-419e-a10b-d7d3fc58d75b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:33.318227 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a22a474d-7c87-419e-a10b-d7d3fc58d75b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:33.333819 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a22a474d-7c87-419e-a10b-d7d3fc58d75b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:33.337013 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a22a474d-7c87-419e-a10b-d7d3fc58d75b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:33.341280 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a22a474d-7c87-419e-a10b-d7d3fc58d75b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:33.342163 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a22a474d-7c87-419e-a10b-d7d3fc58d75b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:33.912929 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3070540c-a4a1-4323-8097-9db457dd0668 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:33.917319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a22a474d-7c87-419e-a10b-d7d3fc58d75b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:33.931186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a22a474d-7c87-419e-a10b-d7d3fc58d75b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.619750 Jun 03 13:03:33.931951 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 85/163] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:33 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:33.937867 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3070540c-a4a1-4323-8097-9db457dd0668 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1365 microversion: 2.1 time: 0.790821 Jun 03 13:03:33.940955 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 79/164] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:33 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1365 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:34.953904 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-29e7a421-95fd-41c6-967e-8bf70955f0f2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:34.955430 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-29e7a421-95fd-41c6-967e-8bf70955f0f2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:34.957150 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d7c86ca6-b429-4d3a-8048-3dd0206ed206 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:34.957889 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d7c86ca6-b429-4d3a-8048-3dd0206ed206 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:34.962815 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29e7a421-95fd-41c6-967e-8bf70955f0f2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:34.963883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29e7a421-95fd-41c6-967e-8bf70955f0f2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:34.964688 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29e7a421-95fd-41c6-967e-8bf70955f0f2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:34.965132 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29e7a421-95fd-41c6-967e-8bf70955f0f2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:34.969295 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7c86ca6-b429-4d3a-8048-3dd0206ed206 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:34.973891 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7c86ca6-b429-4d3a-8048-3dd0206ed206 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:34.974999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7c86ca6-b429-4d3a-8048-3dd0206ed206 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:34.977506 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7c86ca6-b429-4d3a-8048-3dd0206ed206 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:35.370702 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d7c86ca6-b429-4d3a-8048-3dd0206ed206 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:35.384043 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d7c86ca6-b429-4d3a-8048-3dd0206ed206 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1554 microversion: 2.1 time: 0.430995 Jun 03 13:03:35.389255 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 80/165] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:34 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1554 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:35.405784 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d6f0d857-2c7e-4f95-b45e-0f62e1a56a71 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:35.406539 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d6f0d857-2c7e-4f95-b45e-0f62e1a56a71 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:35.417421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6f0d857-2c7e-4f95-b45e-0f62e1a56a71 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:35.420271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6f0d857-2c7e-4f95-b45e-0f62e1a56a71 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:35.421351 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6f0d857-2c7e-4f95-b45e-0f62e1a56a71 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:35.422616 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6f0d857-2c7e-4f95-b45e-0f62e1a56a71 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:35.441836 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-29e7a421-95fd-41c6-967e-8bf70955f0f2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:35.459284 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-29e7a421-95fd-41c6-967e-8bf70955f0f2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.514787 Jun 03 13:03:35.461830 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 86/166] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:34 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:35.643288 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d6f0d857-2c7e-4f95-b45e-0f62e1a56a71 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.245741 Jun 03 13:03:35.654848 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 81/167] 10.222.0.58 () {58 vars in 1274 bytes} [Fri Jun 3 13:03:35 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-interface => generated 284 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:03:36.480331 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-746b5ce3-14c5-4bff-8082-bd2a5fc7e83f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:36.481507 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-746b5ce3-14c5-4bff-8082-bd2a5fc7e83f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:36.507842 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-746b5ce3-14c5-4bff-8082-bd2a5fc7e83f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:36.509614 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-746b5ce3-14c5-4bff-8082-bd2a5fc7e83f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:36.512299 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-746b5ce3-14c5-4bff-8082-bd2a5fc7e83f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:36.514797 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-746b5ce3-14c5-4bff-8082-bd2a5fc7e83f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:36.788798 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-746b5ce3-14c5-4bff-8082-bd2a5fc7e83f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:36.799196 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-746b5ce3-14c5-4bff-8082-bd2a5fc7e83f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.324072 Jun 03 13:03:36.810056 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 87/168] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:36 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:37.816866 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b84bf3ee-673d-4026-bd41-5aab13457a96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:37.817507 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b84bf3ee-673d-4026-bd41-5aab13457a96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:37.836902 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b84bf3ee-673d-4026-bd41-5aab13457a96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:37.844119 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b84bf3ee-673d-4026-bd41-5aab13457a96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:37.845093 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b84bf3ee-673d-4026-bd41-5aab13457a96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:37.845552 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b84bf3ee-673d-4026-bd41-5aab13457a96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:37.886550 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ed10dc36-6032-4f43-b11b-83e43d9bcd90 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:37.888244 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ed10dc36-6032-4f43-b11b-83e43d9bcd90 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:37.897304 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ed10dc36-6032-4f43-b11b-83e43d9bcd90 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:37.899202 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ed10dc36-6032-4f43-b11b-83e43d9bcd90 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:37.900621 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ed10dc36-6032-4f43-b11b-83e43d9bcd90 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:37.902646 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ed10dc36-6032-4f43-b11b-83e43d9bcd90 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:37.964341 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ed10dc36-6032-4f43-b11b-83e43d9bcd90 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:03:38.319663 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ed10dc36-6032-4f43-b11b-83e43d9bcd90 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "DELETE /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 204 len: 0 microversion: 2.1 time: 0.439517 Jun 03 13:03:38.321297 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 88/169] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:03:37 2022] DELETE /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:03:38.329659 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-4ef3fa7c-a3ab-4db4-bf5b-8cd239bc020b req-55b3af67-e469-4486-b08d-902fe74c513e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a85c3fde-c3c5-4354-9c7a-2b432bbdf77c", "tag": "58cc9c4e-cc54-49b9-8e2e-58c0ab81963a"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:03:38.365088 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-4ef3fa7c-a3ab-4db4-bf5b-8cd239bc020b req-55b3af67-e469-4486-b08d-902fe74c513e service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:38.365544 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-4ef3fa7c-a3ab-4db4-bf5b-8cd239bc020b req-55b3af67-e469-4486-b08d-902fe74c513e service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:38.400846 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-4ef3fa7c-a3ab-4db4-bf5b-8cd239bc020b req-55b3af67-e469-4486-b08d-902fe74c513e service nova] Creating event network-changed:58cc9c4e-cc54-49b9-8e2e-58c0ab81963a for instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c on hv-cinder-77954 Jun 03 13:03:38.414974 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-4ef3fa7c-a3ab-4db4-bf5b-8cd239bc020b req-55b3af67-e469-4486-b08d-902fe74c513e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091316 Jun 03 13:03:38.418701 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 89/170] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:03:38.425780 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8834482c-b113-4e6a-9906-0c87bfad8b68 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:38.430478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8834482c-b113-4e6a-9906-0c87bfad8b68 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:38.446147 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8834482c-b113-4e6a-9906-0c87bfad8b68 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:38.454520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8834482c-b113-4e6a-9906-0c87bfad8b68 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:38.455839 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8834482c-b113-4e6a-9906-0c87bfad8b68 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:38.457608 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8834482c-b113-4e6a-9906-0c87bfad8b68 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:38.675309 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b84bf3ee-673d-4026-bd41-5aab13457a96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:38.699572 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b84bf3ee-673d-4026-bd41-5aab13457a96 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.886031 Jun 03 13:03:38.707619 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 82/171] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:37 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:38.860921 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8834482c-b113-4e6a-9906-0c87bfad8b68 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:38.879451 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8834482c-b113-4e6a-9906-0c87bfad8b68 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1553 microversion: 2.1 time: 0.459357 Jun 03 13:03:38.879933 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 90/172] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:38 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1553 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:39.723213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-206f9299-b1da-4382-8155-8d04dadebab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:39.723824 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-206f9299-b1da-4382-8155-8d04dadebab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:39.738258 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-206f9299-b1da-4382-8155-8d04dadebab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:39.738669 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-206f9299-b1da-4382-8155-8d04dadebab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:39.739456 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-206f9299-b1da-4382-8155-8d04dadebab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:39.739876 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-206f9299-b1da-4382-8155-8d04dadebab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:39.898894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8f644f9c-c20b-41bc-b05c-1edece484d56 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:39.900075 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8f644f9c-c20b-41bc-b05c-1edece484d56 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:39.916129 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f644f9c-c20b-41bc-b05c-1edece484d56 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:39.917684 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f644f9c-c20b-41bc-b05c-1edece484d56 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:39.918854 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f644f9c-c20b-41bc-b05c-1edece484d56 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:39.919061 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8f644f9c-c20b-41bc-b05c-1edece484d56 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:40.211997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-206f9299-b1da-4382-8155-8d04dadebab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:40.223988 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-206f9299-b1da-4382-8155-8d04dadebab9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.505928 Jun 03 13:03:40.227408 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 83/173] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:39 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:40.720484 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8f644f9c-c20b-41bc-b05c-1edece484d56 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:40.732035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8f644f9c-c20b-41bc-b05c-1edece484d56 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1553 microversion: 2.1 time: 0.839359 Jun 03 13:03:40.748442 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 91/174] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:39 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1553 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:41.241642 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b8065fcd-abe2-43b2-a4b2-cd5a94a0a655 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:41.242894 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b8065fcd-abe2-43b2-a4b2-cd5a94a0a655 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:41.250694 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8065fcd-abe2-43b2-a4b2-cd5a94a0a655 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:41.256818 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8065fcd-abe2-43b2-a4b2-cd5a94a0a655 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:41.259047 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8065fcd-abe2-43b2-a4b2-cd5a94a0a655 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:41.259824 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8065fcd-abe2-43b2-a4b2-cd5a94a0a655 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:41.742617 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b8065fcd-abe2-43b2-a4b2-cd5a94a0a655 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:41.757318 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b8065fcd-abe2-43b2-a4b2-cd5a94a0a655 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.518630 Jun 03 13:03:41.760163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 84/175] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:41 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:41.784387 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-23b67955-3928-4a4b-9aba-9d31099b3277 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:41.786011 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-23b67955-3928-4a4b-9aba-9d31099b3277 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:41.802602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-23b67955-3928-4a4b-9aba-9d31099b3277 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:41.806245 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-23b67955-3928-4a4b-9aba-9d31099b3277 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:41.807271 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-23b67955-3928-4a4b-9aba-9d31099b3277 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:41.814743 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-23b67955-3928-4a4b-9aba-9d31099b3277 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:42.141505 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-23b67955-3928-4a4b-9aba-9d31099b3277 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:42.157052 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-23b67955-3928-4a4b-9aba-9d31099b3277 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1553 microversion: 2.1 time: 0.385323 Jun 03 13:03:42.172574 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 92/176] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:41 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1553 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:42.746860 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-3ec4105f-a5a6-4ee7-8b03-7beac4ec63d4 req-35ae221f-ad14-405d-8dfa-5c0acd0ed09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730b6a27-293e-4481-8a66-c4b15dccceeb", "name": "network-vif-deleted", "tag": "6df05199-0112-4ee8-a950-61d4404cd566"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:03:42.770065 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-3ec4105f-a5a6-4ee7-8b03-7beac4ec63d4 req-35ae221f-ad14-405d-8dfa-5c0acd0ed09e service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:42.771987 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-3ec4105f-a5a6-4ee7-8b03-7beac4ec63d4 req-35ae221f-ad14-405d-8dfa-5c0acd0ed09e service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:42.781945 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f865ecca-daf8-4542-8529-1668bd50b9b1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:42.783822 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f865ecca-daf8-4542-8529-1668bd50b9b1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:42.803419 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f865ecca-daf8-4542-8529-1668bd50b9b1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:42.805894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f865ecca-daf8-4542-8529-1668bd50b9b1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:42.809344 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f865ecca-daf8-4542-8529-1668bd50b9b1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:42.811114 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f865ecca-daf8-4542-8529-1668bd50b9b1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:42.824121 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-3ec4105f-a5a6-4ee7-8b03-7beac4ec63d4 req-35ae221f-ad14-405d-8dfa-5c0acd0ed09e service nova] Creating event network-vif-deleted:6df05199-0112-4ee8-a950-61d4404cd566 for instance 730b6a27-293e-4481-8a66-c4b15dccceeb on hv-cinder-77954 Jun 03 13:03:42.839308 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-3ec4105f-a5a6-4ee7-8b03-7beac4ec63d4 req-35ae221f-ad14-405d-8dfa-5c0acd0ed09e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102807 Jun 03 13:03:42.840271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 85/177] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:03:43.181552 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6a34bf61-a257-47d1-987e-b2f035bfe1ca tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:43.181990 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6a34bf61-a257-47d1-987e-b2f035bfe1ca tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:43.189426 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a34bf61-a257-47d1-987e-b2f035bfe1ca tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:43.190216 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a34bf61-a257-47d1-987e-b2f035bfe1ca tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:43.191222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a34bf61-a257-47d1-987e-b2f035bfe1ca tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:43.191922 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a34bf61-a257-47d1-987e-b2f035bfe1ca tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:43.234049 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f865ecca-daf8-4542-8529-1668bd50b9b1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:43.245353 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f865ecca-daf8-4542-8529-1668bd50b9b1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.468602 Jun 03 13:03:43.256266 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 93/178] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:42 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:43.298103 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6a34bf61-a257-47d1-987e-b2f035bfe1ca tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:43.311412 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6a34bf61-a257-47d1-987e-b2f035bfe1ca tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1345 microversion: 2.1 time: 0.135224 Jun 03 13:03:43.312612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 86/179] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:43 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:44.263196 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-385b107c-1896-4900-aa5d-91310c7a1c07 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:44.263800 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-385b107c-1896-4900-aa5d-91310c7a1c07 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:44.270256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-385b107c-1896-4900-aa5d-91310c7a1c07 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:44.270920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-385b107c-1896-4900-aa5d-91310c7a1c07 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:44.271713 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-385b107c-1896-4900-aa5d-91310c7a1c07 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:44.272249 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-385b107c-1896-4900-aa5d-91310c7a1c07 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:44.329103 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-05b22e7d-0e76-431a-9db9-61a762746b54 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:44.330390 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-05b22e7d-0e76-431a-9db9-61a762746b54 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:44.337933 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05b22e7d-0e76-431a-9db9-61a762746b54 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:44.338706 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05b22e7d-0e76-431a-9db9-61a762746b54 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:44.339660 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05b22e7d-0e76-431a-9db9-61a762746b54 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:44.340263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05b22e7d-0e76-431a-9db9-61a762746b54 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:44.705801 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-05b22e7d-0e76-431a-9db9-61a762746b54 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:44.716897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-05b22e7d-0e76-431a-9db9-61a762746b54 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1345 microversion: 2.1 time: 0.391952 Jun 03 13:03:44.718468 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 87/180] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:44 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1345 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:44.787308 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-385b107c-1896-4900-aa5d-91310c7a1c07 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:44.804185 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-385b107c-1896-4900-aa5d-91310c7a1c07 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.545300 Jun 03 13:03:44.805922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 94/181] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:44 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:45.738461 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3e464b94-9464-484d-be8a-bba6b4971f53 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:45.740169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3e464b94-9464-484d-be8a-bba6b4971f53 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:45.746998 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=56 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:45.749942 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e464b94-9464-484d-be8a-bba6b4971f53 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:45.750501 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e464b94-9464-484d-be8a-bba6b4971f53 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:45.751471 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e464b94-9464-484d-be8a-bba6b4971f53 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:45.752413 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3e464b94-9464-484d-be8a-bba6b4971f53 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:45.825145 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-de136048-b36f-49f3-8b63-9c200d0f803f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:45.825824 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-de136048-b36f-49f3-8b63-9c200d0f803f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:45.834944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-de136048-b36f-49f3-8b63-9c200d0f803f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:45.836180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-de136048-b36f-49f3-8b63-9c200d0f803f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:45.837851 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-de136048-b36f-49f3-8b63-9c200d0f803f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:45.838410 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-de136048-b36f-49f3-8b63-9c200d0f803f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:45.838744 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3e464b94-9464-484d-be8a-bba6b4971f53 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:45.856083 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3e464b94-9464-484d-be8a-bba6b4971f53 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1345 microversion: 2.1 time: 0.119250 Jun 03 13:03:45.861148 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 88/182] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:45 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:46.092945 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-de136048-b36f-49f3-8b63-9c200d0f803f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:46.103542 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-de136048-b36f-49f3-8b63-9c200d0f803f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.285764 Jun 03 13:03:46.114362 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 95/183] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:45 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:46.877027 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e085a150-3e16-4e26-a2d9-ffc5f00572b8 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:46.877647 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e085a150-3e16-4e26-a2d9-ffc5f00572b8 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:46.884704 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e085a150-3e16-4e26-a2d9-ffc5f00572b8 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:46.885147 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e085a150-3e16-4e26-a2d9-ffc5f00572b8 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:46.886331 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e085a150-3e16-4e26-a2d9-ffc5f00572b8 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:46.886973 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e085a150-3e16-4e26-a2d9-ffc5f00572b8 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:46.980378 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e085a150-3e16-4e26-a2d9-ffc5f00572b8 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:46.989699 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e085a150-3e16-4e26-a2d9-ffc5f00572b8 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1345 microversion: 2.1 time: 0.116761 Jun 03 13:03:46.990329 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 89/184] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:46 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:47.122614 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8a1b5f1-79dc-45f8-808c-4d2ce00ad8c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:47.123439 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d8a1b5f1-79dc-45f8-808c-4d2ce00ad8c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:47.129400 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:47.131202 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8a1b5f1-79dc-45f8-808c-4d2ce00ad8c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:47.131861 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8a1b5f1-79dc-45f8-808c-4d2ce00ad8c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:47.132741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8a1b5f1-79dc-45f8-808c-4d2ce00ad8c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:47.133208 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8a1b5f1-79dc-45f8-808c-4d2ce00ad8c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:47.274635 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8a1b5f1-79dc-45f8-808c-4d2ce00ad8c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:47.285787 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8a1b5f1-79dc-45f8-808c-4d2ce00ad8c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.167116 Jun 03 13:03:47.286437 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 96/185] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:47 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:48.005836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c34a41fd-59ac-4860-bfa0-a5f22a31f94a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:48.006511 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c34a41fd-59ac-4860-bfa0-a5f22a31f94a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:48.014433 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c34a41fd-59ac-4860-bfa0-a5f22a31f94a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:48.015144 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c34a41fd-59ac-4860-bfa0-a5f22a31f94a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:48.015989 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c34a41fd-59ac-4860-bfa0-a5f22a31f94a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:48.016506 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c34a41fd-59ac-4860-bfa0-a5f22a31f94a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:48.032023 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:48.085088 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c34a41fd-59ac-4860-bfa0-a5f22a31f94a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:48.093706 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c34a41fd-59ac-4860-bfa0-a5f22a31f94a tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1345 microversion: 2.1 time: 0.091791 Jun 03 13:03:48.094605 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 90/186] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:48 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:48.302890 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cf853f93-3df9-4d48-8ab6-6bdeb203b4fe tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:48.304199 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cf853f93-3df9-4d48-8ab6-6bdeb203b4fe tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:48.315676 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf853f93-3df9-4d48-8ab6-6bdeb203b4fe tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:48.316131 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf853f93-3df9-4d48-8ab6-6bdeb203b4fe tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:48.317101 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf853f93-3df9-4d48-8ab6-6bdeb203b4fe tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:48.317566 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cf853f93-3df9-4d48-8ab6-6bdeb203b4fe tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:48.556414 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cf853f93-3df9-4d48-8ab6-6bdeb203b4fe tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:48.570325 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cf853f93-3df9-4d48-8ab6-6bdeb203b4fe tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.271400 Jun 03 13:03:48.581923 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 97/187] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:48 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:49.111403 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6bf0493c-2a6d-40b5-bff7-c21b14611d1f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:49.112771 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6bf0493c-2a6d-40b5-bff7-c21b14611d1f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:49.119749 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6bf0493c-2a6d-40b5-bff7-c21b14611d1f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:49.120304 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6bf0493c-2a6d-40b5-bff7-c21b14611d1f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:49.121164 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6bf0493c-2a6d-40b5-bff7-c21b14611d1f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:49.121669 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6bf0493c-2a6d-40b5-bff7-c21b14611d1f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:49.196510 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6bf0493c-2a6d-40b5-bff7-c21b14611d1f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:49.206466 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6bf0493c-2a6d-40b5-bff7-c21b14611d1f tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1345 microversion: 2.1 time: 0.099189 Jun 03 13:03:49.207533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 91/188] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:49 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:49.602260 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6df2ef28-a076-4567-aea2-c556c56a1528 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:49.603578 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6df2ef28-a076-4567-aea2-c556c56a1528 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:49.611851 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6df2ef28-a076-4567-aea2-c556c56a1528 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:49.614667 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6df2ef28-a076-4567-aea2-c556c56a1528 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:49.615758 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6df2ef28-a076-4567-aea2-c556c56a1528 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:49.616409 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6df2ef28-a076-4567-aea2-c556c56a1528 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:49.778377 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6df2ef28-a076-4567-aea2-c556c56a1528 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:49.787661 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6df2ef28-a076-4567-aea2-c556c56a1528 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.202914 Jun 03 13:03:49.788812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 98/189] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:49 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:50.226454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ec25aae1-4145-4c15-b555-a82121d91f43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:50.227070 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ec25aae1-4145-4c15-b555-a82121d91f43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:50.244186 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec25aae1-4145-4c15-b555-a82121d91f43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:50.244645 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec25aae1-4145-4c15-b555-a82121d91f43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:50.245457 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec25aae1-4145-4c15-b555-a82121d91f43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:50.245895 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec25aae1-4145-4c15-b555-a82121d91f43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:50.452521 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ec25aae1-4145-4c15-b555-a82121d91f43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8635705162e04b8fae768d98c5c672c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd12390001445ba8e59d21bd11b34f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:50.489666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ec25aae1-4145-4c15-b555-a82121d91f43 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 200 len: 1345 microversion: 2.1 time: 0.267195 Jun 03 13:03:50.501820 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 92/190] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:50 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 1345 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:50.807687 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-66ae170c-eb06-4175-967b-3a73facfb10a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:50.810278 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-66ae170c-eb06-4175-967b-3a73facfb10a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:50.827204 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-66ae170c-eb06-4175-967b-3a73facfb10a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:50.829371 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-66ae170c-eb06-4175-967b-3a73facfb10a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:50.833355 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-66ae170c-eb06-4175-967b-3a73facfb10a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:50.834150 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-66ae170c-eb06-4175-967b-3a73facfb10a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:50.875811 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:03:51.062252 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-66ae170c-eb06-4175-967b-3a73facfb10a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:51.070931 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-66ae170c-eb06-4175-967b-3a73facfb10a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.269979 Jun 03 13:03:51.073188 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 99/191] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:50 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:51.508125 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a2f28cb1-7650-43cb-a249-c87f626b5de5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:51.508125 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a2f28cb1-7650-43cb-a249-c87f626b5de5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:51.521806 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2f28cb1-7650-43cb-a249-c87f626b5de5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:51.522691 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2f28cb1-7650-43cb-a249-c87f626b5de5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:51.523698 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2f28cb1-7650-43cb-a249-c87f626b5de5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:51.524340 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2f28cb1-7650-43cb-a249-c87f626b5de5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:51.561704 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-a2f28cb1-7650-43cb-a249-c87f626b5de5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] HTTP exception thrown: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a2f28cb1-7650-43cb-a249-c87f626b5de5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Request method failure captured: Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb HTTP/1.1 Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgZWAm5Ek_OcSJhhpFYbkmq3pYAx7MNApBIB7DFPU6TY-BnULkrLiwjmzPcVNwOhiFRphBfadECINakaeaXP0glrBj1xIAUpGippX35aq4gALk00ubp2WTiz-665VLuaZLteBBPM351HUsWsXqqjKPDRucSgDij3Ie5cfWFIXp4XtAQ Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 4dd12390001445ba8e59d21bd11b34f4 Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-DeleteServersTestJSON-300492878 Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:03:51.575009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:03:51.576335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dd12390001445ba8e59d21bd11b34f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4dd12390001445ba8e59d21bd11b34f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4dd12390001445ba8e59d21bd11b34f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dd12390001445ba8e59d21bd11b34f4"}]}] Jun 03 13:03:51.576335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-DeleteServersTestJSON-300492878 Jun 03 13:03:51.576335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 4dd12390001445ba8e59d21bd11b34f4 Jun 03 13:03:51.576335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-DeleteServersTestJSON-300492878 Jun 03 13:03:51.576335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-DeleteServersTestJSON-300492878-project Jun 03 13:03:51.576335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:03:51.576335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:03:51.576335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 8635705162e04b8fae768d98c5c672c2 Jun 03 13:03:51.576335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-DeleteServersTestJSON-300492878-project Jun 03 13:03:51.576335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:03:51.576335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:51.576335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '730b6a27-293e-4481-8a66-c4b15dccceeb'} Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:03:51.577040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:51.578207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:03:51.581332 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a2f28cb1-7650-43cb-a249-c87f626b5de5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Returning 404 to user: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:03:51.582575 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a2f28cb1-7650-43cb-a249-c87f626b5de5 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 404 len: 111 microversion: 2.1 time: 0.079764 Jun 03 13:03:51.588757 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 93/192] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:51 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:03:51.746507 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-810c6af6-175c-460e-a211-292676a969cd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:51.747483 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-810c6af6-175c-460e-a211-292676a969cd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:51.758342 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-810c6af6-175c-460e-a211-292676a969cd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:51.762035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-810c6af6-175c-460e-a211-292676a969cd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:51.763111 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-810c6af6-175c-460e-a211-292676a969cd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:51.765386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-810c6af6-175c-460e-a211-292676a969cd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:51.796003 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-810c6af6-175c-460e-a211-292676a969cd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] HTTP exception thrown: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-810c6af6-175c-460e-a211-292676a969cd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Request method failure captured: Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb/os-volume_attachments HTTP/1.1 Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZWAm5Ek_OcSJhhpFYbkmq3pYAx7MNApBIB7DFPU6TY-BnULkrLiwjmzPcVNwOhiFRphBfadECINakaeaXP0glrBj1xIAUpGippX35aq4gALk00ubp2WTiz-665VLuaZLteBBPM351HUsWsXqqjKPDRucSgDij3Ie5cfWFIXp4XtAQ Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 4dd12390001445ba8e59d21bd11b34f4 Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-DeleteServersTestJSON-300492878 Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:03:51.810320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:03:51.812250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dd12390001445ba8e59d21bd11b34f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4dd12390001445ba8e59d21bd11b34f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4dd12390001445ba8e59d21bd11b34f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dd12390001445ba8e59d21bd11b34f4"}]}] Jun 03 13:03:51.812250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-DeleteServersTestJSON-300492878 Jun 03 13:03:51.812250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 4dd12390001445ba8e59d21bd11b34f4 Jun 03 13:03:51.812250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-DeleteServersTestJSON-300492878 Jun 03 13:03:51.812250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-DeleteServersTestJSON-300492878-project Jun 03 13:03:51.812250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:03:51.812250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:03:51.812250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 8635705162e04b8fae768d98c5c672c2 Jun 03 13:03:51.812250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-DeleteServersTestJSON-300492878-project Jun 03 13:03:51.812250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:03:51.812250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:51.812250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'server_id': '730b6a27-293e-4481-8a66-c4b15dccceeb'} Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:03:51.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:51.814186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:03:51.816924 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-810c6af6-175c-460e-a211-292676a969cd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Returning 404 to user: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:03:51.818201 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-810c6af6-175c-460e-a211-292676a969cd tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.075720 Jun 03 13:03:51.819266 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 100/193] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:03:51 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb/os-volume_attachments => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:03:52.093080 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e619ff34-f75b-4862-9580-451421824688 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:52.106985 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e619ff34-f75b-4862-9580-451421824688 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:52.134398 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e619ff34-f75b-4862-9580-451421824688 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:52.135337 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e619ff34-f75b-4862-9580-451421824688 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:52.136992 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e619ff34-f75b-4862-9580-451421824688 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:52.140969 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e619ff34-f75b-4862-9580-451421824688 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:52.401623 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e619ff34-f75b-4862-9580-451421824688 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:52.418254 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e619ff34-f75b-4862-9580-451421824688 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.332733 Jun 03 13:03:52.438436 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 94/194] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:52 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:53.199724 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-69ed3789-f394-46aa-9559-efd2daafa9c2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:53.200802 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-69ed3789-f394-46aa-9559-efd2daafa9c2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:53.211034 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-69ed3789-f394-46aa-9559-efd2daafa9c2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:53.211480 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-69ed3789-f394-46aa-9559-efd2daafa9c2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:53.215913 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-69ed3789-f394-46aa-9559-efd2daafa9c2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:53.216643 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-69ed3789-f394-46aa-9559-efd2daafa9c2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:53.249984 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-69ed3789-f394-46aa-9559-efd2daafa9c2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] HTTP exception thrown: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-69ed3789-f394-46aa-9559-efd2daafa9c2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Request method failure captured: Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb HTTP/1.1 Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZWAm5Ek_OcSJhhpFYbkmq3pYAx7MNApBIB7DFPU6TY-BnULkrLiwjmzPcVNwOhiFRphBfadECINakaeaXP0glrBj1xIAUpGippX35aq4gALk00ubp2WTiz-665VLuaZLteBBPM351HUsWsXqqjKPDRucSgDij3Ie5cfWFIXp4XtAQ Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 4dd12390001445ba8e59d21bd11b34f4 Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-DeleteServersTestJSON-300492878 Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:03:53.252741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:03:53.255017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dd12390001445ba8e59d21bd11b34f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4dd12390001445ba8e59d21bd11b34f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4dd12390001445ba8e59d21bd11b34f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dd12390001445ba8e59d21bd11b34f4"}]}] Jun 03 13:03:53.255017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-DeleteServersTestJSON-300492878 Jun 03 13:03:53.255017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 4dd12390001445ba8e59d21bd11b34f4 Jun 03 13:03:53.255017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-DeleteServersTestJSON-300492878 Jun 03 13:03:53.255017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-DeleteServersTestJSON-300492878-project Jun 03 13:03:53.255017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:03:53.255017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:03:53.255017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 8635705162e04b8fae768d98c5c672c2 Jun 03 13:03:53.255017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-DeleteServersTestJSON-300492878-project Jun 03 13:03:53.255017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:03:53.255017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:53.255017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '730b6a27-293e-4481-8a66-c4b15dccceeb'} Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:03:53.255812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:53.257107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:03:53.260777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-69ed3789-f394-46aa-9559-efd2daafa9c2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Returning 404 to user: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:03:53.262876 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-69ed3789-f394-46aa-9559-efd2daafa9c2 tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "DELETE /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 404 len: 111 microversion: 2.1 time: 0.068565 Jun 03 13:03:53.264239 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 101/195] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:03:53 2022] DELETE /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:03:53.273940 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ea52843a-0de4-43f2-b5df-7d84b1f2666e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:53.275222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ea52843a-0de4-43f2-b5df-7d84b1f2666e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] [instance: 730b6a27-293e-4481-8a66-c4b15dccceeb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:53.287184 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea52843a-0de4-43f2-b5df-7d84b1f2666e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:53.288389 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea52843a-0de4-43f2-b5df-7d84b1f2666e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:53.289877 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea52843a-0de4-43f2-b5df-7d84b1f2666e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:53.290318 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea52843a-0de4-43f2-b5df-7d84b1f2666e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:53.323166 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-ea52843a-0de4-43f2-b5df-7d84b1f2666e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] HTTP exception thrown: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ea52843a-0de4-43f2-b5df-7d84b1f2666e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Request method failure captured: Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb HTTP/1.1 Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgZWAm5Ek_OcSJhhpFYbkmq3pYAx7MNApBIB7DFPU6TY-BnULkrLiwjmzPcVNwOhiFRphBfadECINakaeaXP0glrBj1xIAUpGippX35aq4gALk00ubp2WTiz-665VLuaZLteBBPM351HUsWsXqqjKPDRucSgDij3Ie5cfWFIXp4XtAQ Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 4dd12390001445ba8e59d21bd11b34f4 Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-DeleteServersTestJSON-300492878 Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:03:53.325811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:03:53.329538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dd12390001445ba8e59d21bd11b34f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4dd12390001445ba8e59d21bd11b34f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4dd12390001445ba8e59d21bd11b34f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4dd12390001445ba8e59d21bd11b34f4"}]}] Jun 03 13:03:53.329538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-DeleteServersTestJSON-300492878 Jun 03 13:03:53.329538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 4dd12390001445ba8e59d21bd11b34f4 Jun 03 13:03:53.329538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-DeleteServersTestJSON-300492878 Jun 03 13:03:53.329538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-DeleteServersTestJSON-300492878-project Jun 03 13:03:53.329538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:03:53.329538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:03:53.329538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 8635705162e04b8fae768d98c5c672c2 Jun 03 13:03:53.329538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-DeleteServersTestJSON-300492878-project Jun 03 13:03:53.329538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:03:53.329538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:53.329538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '730b6a27-293e-4481-8a66-c4b15dccceeb'} Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:03:53.330355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. Jun 03 13:03:53.331674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:03:53.332719 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ea52843a-0de4-43f2-b5df-7d84b1f2666e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] Returning 404 to user: Instance 730b6a27-293e-4481-8a66-c4b15dccceeb could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:03:53.332719 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ea52843a-0de4-43f2-b5df-7d84b1f2666e tempest-DeleteServersTestJSON-300492878 tempest-DeleteServersTestJSON-300492878-project] 10.222.0.58 "GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb" status: 404 len: 111 microversion: 2.1 time: 0.060454 Jun 03 13:03:53.343465 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 95/196] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:53 2022] GET /compute/v2.1/servers/730b6a27-293e-4481-8a66-c4b15dccceeb => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:03:53.436820 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-aab0a54d-1a3d-436f-9539-601855e9abbf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:53.438349 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-aab0a54d-1a3d-436f-9539-601855e9abbf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:53.453103 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aab0a54d-1a3d-436f-9539-601855e9abbf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:53.454560 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aab0a54d-1a3d-436f-9539-601855e9abbf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:53.455735 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aab0a54d-1a3d-436f-9539-601855e9abbf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:53.456578 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aab0a54d-1a3d-436f-9539-601855e9abbf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:53.868844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-aab0a54d-1a3d-436f-9539-601855e9abbf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:53.879437 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-aab0a54d-1a3d-436f-9539-601855e9abbf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.447969 Jun 03 13:03:53.881236 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 102/197] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:53 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:03:54.897921 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9980895b-e130-49d2-90c4-ed2a9a4813f3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:54.899044 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9980895b-e130-49d2-90c4-ed2a9a4813f3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:54.917519 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9980895b-e130-49d2-90c4-ed2a9a4813f3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:54.918256 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9980895b-e130-49d2-90c4-ed2a9a4813f3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:54.919274 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9980895b-e130-49d2-90c4-ed2a9a4813f3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:54.919710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9980895b-e130-49d2-90c4-ed2a9a4813f3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:55.149719 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9980895b-e130-49d2-90c4-ed2a9a4813f3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:55.160993 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9980895b-e130-49d2-90c4-ed2a9a4813f3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.267229 Jun 03 13:03:55.162608 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 96/198] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:54 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:56.181537 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-849d6def-47c8-4e2e-a7e5-feb10629f8d2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:56.183458 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-849d6def-47c8-4e2e-a7e5-feb10629f8d2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:56.192755 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-849d6def-47c8-4e2e-a7e5-feb10629f8d2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:56.193848 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-849d6def-47c8-4e2e-a7e5-feb10629f8d2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:56.195865 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-849d6def-47c8-4e2e-a7e5-feb10629f8d2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:56.196515 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-849d6def-47c8-4e2e-a7e5-feb10629f8d2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:56.416575 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-849d6def-47c8-4e2e-a7e5-feb10629f8d2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:56.432783 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-849d6def-47c8-4e2e-a7e5-feb10629f8d2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.250382 Jun 03 13:03:56.433829 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 103/199] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:56 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:57.451079 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-249799f6-04fb-41e3-bc4a-c85ca2acd5d5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:57.455732 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-249799f6-04fb-41e3-bc4a-c85ca2acd5d5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:57.474753 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-249799f6-04fb-41e3-bc4a-c85ca2acd5d5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:57.480211 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-249799f6-04fb-41e3-bc4a-c85ca2acd5d5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:57.482435 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-249799f6-04fb-41e3-bc4a-c85ca2acd5d5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:57.484913 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-249799f6-04fb-41e3-bc4a-c85ca2acd5d5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:57.746617 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-249799f6-04fb-41e3-bc4a-c85ca2acd5d5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:57.758425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-249799f6-04fb-41e3-bc4a-c85ca2acd5d5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.312067 Jun 03 13:03:57.760765 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 97/200] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:57 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:03:58.779216 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c4446feb-ff0d-43fe-9da1-0d2c9a014112 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:03:58.780908 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c4446feb-ff0d-43fe-9da1-0d2c9a014112 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:03:58.795717 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c4446feb-ff0d-43fe-9da1-0d2c9a014112 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:58.798783 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c4446feb-ff0d-43fe-9da1-0d2c9a014112 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:58.799654 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c4446feb-ff0d-43fe-9da1-0d2c9a014112 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:03:58.802879 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c4446feb-ff0d-43fe-9da1-0d2c9a014112 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:03:59.009817 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c4446feb-ff0d-43fe-9da1-0d2c9a014112 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:03:59.030567 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c4446feb-ff0d-43fe-9da1-0d2c9a014112 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.248629 Jun 03 13:03:59.033929 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 104/201] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:03:58 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:00.048756 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-45526991-7928-4489-9710-6d2e68aa9f27 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:00.050023 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-45526991-7928-4489-9710-6d2e68aa9f27 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:00.058561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45526991-7928-4489-9710-6d2e68aa9f27 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:00.058986 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45526991-7928-4489-9710-6d2e68aa9f27 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:00.059754 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45526991-7928-4489-9710-6d2e68aa9f27 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:00.060184 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45526991-7928-4489-9710-6d2e68aa9f27 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:00.223639 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-45526991-7928-4489-9710-6d2e68aa9f27 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:00.237526 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-45526991-7928-4489-9710-6d2e68aa9f27 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.192816 Jun 03 13:04:00.238844 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 98/202] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:00 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:00.535398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-522235eb-5e28-486a-b4a9-d8dbc0811838 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Action: 'create', calling method: .version_select at 0x7fc5a466d820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1476437325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6FV40SAvmL+JGhEjhroREuXpkKmVmUGr2N/1sUcMmv40ZPMqz6ju3PL8RNJhKEIDB38dEYHeZm5AsBuN9E/f20vd+fMOMPO8xbfnsjVExX6GeJ/SG+4JyW0P5CDQNYwg=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:04:00.551491 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-522235eb-5e28-486a-b4a9-d8dbc0811838 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Getting quotas for project 80d06506691e4947b14192431bed4453. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:04:00.555544 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-522235eb-5e28-486a-b4a9-d8dbc0811838 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Getting quotas for user 94dbfb6cf680454f883d43796f05c799 and project 80d06506691e4947b14192431bed4453. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:04:00.578921 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-522235eb-5e28-486a-b4a9-d8dbc0811838 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047395 Jun 03 13:04:00.579669 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 105/203] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Jun 3 13:04:00 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:04:00.682437 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-294576626", "imageRef": "d148a266-1796-41c2-b940-f85cb2f6398f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1476437325", "networks": [{"uuid": "b0313241-c3c5-422a-8dd7-46ed86e26755"}]}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:04:00.734493 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] validate_networks() for [('b0313241-c3c5-422a-8dd7-46ed86e26755', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:04:01.133213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:04:01.133795 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:04:01.134237 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:04:01.134648 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:04:01.135302 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:04:01.145429 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:01.145868 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:01.146696 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:01.147156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:01.163441 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Getting quotas for project 80d06506691e4947b14192431bed4453. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:04:01.167338 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Getting quotas for user 94dbfb6cf680454f883d43796f05c799 and project 80d06506691e4947b14192431bed4453. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:04:01.178243 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:04:01.180480 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d148a266-1796-41c2-b940-f85cb2f6398f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:04:01.231862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-58cad537-799f-43f5-bf6b-e7cfb106e3de tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553295 Jun 03 13:04:01.232467 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 99/204] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:04:01.243053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-28e8ae54-e83c-4a9e-a2be-149bb17aba8b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:01.243751 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-28e8ae54-e83c-4a9e-a2be-149bb17aba8b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:01.254961 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cf1ce151-010a-4f17-8e15-40ec2c6ae4b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:01.255543 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cf1ce151-010a-4f17-8e15-40ec2c6ae4b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:01.262043 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cf1ce151-010a-4f17-8e15-40ec2c6ae4b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:01.262557 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cf1ce151-010a-4f17-8e15-40ec2c6ae4b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:01.263324 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cf1ce151-010a-4f17-8e15-40ec2c6ae4b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:01.263763 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cf1ce151-010a-4f17-8e15-40ec2c6ae4b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:01.319144 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-28e8ae54-e83c-4a9e-a2be-149bb17aba8b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:01.328838 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-28e8ae54-e83c-4a9e-a2be-149bb17aba8b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1258 microversion: 2.1 time: 0.089674 Jun 03 13:04:01.329424 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 106/205] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:01 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:01.423218 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cf1ce151-010a-4f17-8e15-40ec2c6ae4b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:01.431820 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cf1ce151-010a-4f17-8e15-40ec2c6ae4b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.180922 Jun 03 13:04:01.432408 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 100/206] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:01 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:02.346050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5df5c8ce-9e74-4acf-9a2c-5104fe69190a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:02.346687 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5df5c8ce-9e74-4acf-9a2c-5104fe69190a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:02.354665 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5df5c8ce-9e74-4acf-9a2c-5104fe69190a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:02.355103 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5df5c8ce-9e74-4acf-9a2c-5104fe69190a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:02.356019 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5df5c8ce-9e74-4acf-9a2c-5104fe69190a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:02.356455 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5df5c8ce-9e74-4acf-9a2c-5104fe69190a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:02.430826 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5df5c8ce-9e74-4acf-9a2c-5104fe69190a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:02.438369 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5df5c8ce-9e74-4acf-9a2c-5104fe69190a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1262 microversion: 2.1 time: 0.096356 Jun 03 13:04:02.438940 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 107/207] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:02 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:04:02.448818 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-01bde346-f8bb-4a88-b8ec-c11809318cea tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:02.449409 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-01bde346-f8bb-4a88-b8ec-c11809318cea tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:02.456244 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-01bde346-f8bb-4a88-b8ec-c11809318cea tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:02.456715 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-01bde346-f8bb-4a88-b8ec-c11809318cea tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:02.457556 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-01bde346-f8bb-4a88-b8ec-c11809318cea tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:02.458039 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-01bde346-f8bb-4a88-b8ec-c11809318cea tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:02.595284 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-01bde346-f8bb-4a88-b8ec-c11809318cea tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:02.604164 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-01bde346-f8bb-4a88-b8ec-c11809318cea tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.158736 Jun 03 13:04:02.613775 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 101/208] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:02 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:03.455657 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8a4becbe-f1ee-40ff-85d4-516084958e01 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:03.456274 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8a4becbe-f1ee-40ff-85d4-516084958e01 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:03.462881 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a4becbe-f1ee-40ff-85d4-516084958e01 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:03.463331 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a4becbe-f1ee-40ff-85d4-516084958e01 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:03.464110 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a4becbe-f1ee-40ff-85d4-516084958e01 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:03.464548 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a4becbe-f1ee-40ff-85d4-516084958e01 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:03.534073 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8a4becbe-f1ee-40ff-85d4-516084958e01 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:03.543751 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8a4becbe-f1ee-40ff-85d4-516084958e01 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1310 microversion: 2.1 time: 0.091663 Jun 03 13:04:03.545120 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 108/209] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:03 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:03.621127 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b050cb2c-e227-4d03-b13a-196e80b8abb2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:03.621821 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b050cb2c-e227-4d03-b13a-196e80b8abb2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:03.628495 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b050cb2c-e227-4d03-b13a-196e80b8abb2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:03.629052 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b050cb2c-e227-4d03-b13a-196e80b8abb2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:03.629893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b050cb2c-e227-4d03-b13a-196e80b8abb2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:03.630437 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b050cb2c-e227-4d03-b13a-196e80b8abb2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:03.766865 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b050cb2c-e227-4d03-b13a-196e80b8abb2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:03.774722 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b050cb2c-e227-4d03-b13a-196e80b8abb2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.157825 Jun 03 13:04:03.775487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 102/210] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:03 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:04.562775 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e230c940-9796-490c-83e4-c3a1a38dad08 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:04.563559 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e230c940-9796-490c-83e4-c3a1a38dad08 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:04.570903 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e230c940-9796-490c-83e4-c3a1a38dad08 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:04.571366 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e230c940-9796-490c-83e4-c3a1a38dad08 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:04.572141 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e230c940-9796-490c-83e4-c3a1a38dad08 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:04.572581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e230c940-9796-490c-83e4-c3a1a38dad08 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:04.643737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e230c940-9796-490c-83e4-c3a1a38dad08 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:04.652231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e230c940-9796-490c-83e4-c3a1a38dad08 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1310 microversion: 2.1 time: 0.094329 Jun 03 13:04:04.652793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 109/211] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:04 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:04.796282 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3832b557-68b1-4b24-bdc9-2d39d5da33f7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:04.797542 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3832b557-68b1-4b24-bdc9-2d39d5da33f7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:04.806143 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3832b557-68b1-4b24-bdc9-2d39d5da33f7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:04.806664 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3832b557-68b1-4b24-bdc9-2d39d5da33f7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:04.807447 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3832b557-68b1-4b24-bdc9-2d39d5da33f7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:04.807880 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3832b557-68b1-4b24-bdc9-2d39d5da33f7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:04.942659 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3832b557-68b1-4b24-bdc9-2d39d5da33f7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:04.950797 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3832b557-68b1-4b24-bdc9-2d39d5da33f7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.160983 Jun 03 13:04:04.951363 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 103/212] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:04 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:05.675639 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ee57096b-756e-4904-b6f2-42bc71464be5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:05.676909 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ee57096b-756e-4904-b6f2-42bc71464be5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:05.683515 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee57096b-756e-4904-b6f2-42bc71464be5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:05.683974 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee57096b-756e-4904-b6f2-42bc71464be5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:05.684751 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee57096b-756e-4904-b6f2-42bc71464be5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:05.685190 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee57096b-756e-4904-b6f2-42bc71464be5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:05.761141 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ee57096b-756e-4904-b6f2-42bc71464be5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:05.768643 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ee57096b-756e-4904-b6f2-42bc71464be5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1318 microversion: 2.1 time: 0.100184 Jun 03 13:04:05.769211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 110/213] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:05 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1318 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:05.972663 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f28dca0c-b1ed-41ca-9bff-520416df5895 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:05.973797 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f28dca0c-b1ed-41ca-9bff-520416df5895 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:05.981146 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f28dca0c-b1ed-41ca-9bff-520416df5895 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:05.981615 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f28dca0c-b1ed-41ca-9bff-520416df5895 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:05.982456 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f28dca0c-b1ed-41ca-9bff-520416df5895 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:05.983250 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f28dca0c-b1ed-41ca-9bff-520416df5895 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:06.115848 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f28dca0c-b1ed-41ca-9bff-520416df5895 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:06.123553 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f28dca0c-b1ed-41ca-9bff-520416df5895 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.157392 Jun 03 13:04:06.124099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 104/214] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:05 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:06.795849 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ce9dffe9-4f40-4749-bc64-bcafd2f99c13 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:06.797067 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ce9dffe9-4f40-4749-bc64-bcafd2f99c13 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:06.803846 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce9dffe9-4f40-4749-bc64-bcafd2f99c13 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:06.804305 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce9dffe9-4f40-4749-bc64-bcafd2f99c13 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:06.805091 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce9dffe9-4f40-4749-bc64-bcafd2f99c13 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:06.805534 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ce9dffe9-4f40-4749-bc64-bcafd2f99c13 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:06.887134 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ce9dffe9-4f40-4749-bc64-bcafd2f99c13 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:06.894878 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ce9dffe9-4f40-4749-bc64-bcafd2f99c13 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1318 microversion: 2.1 time: 0.103060 Jun 03 13:04:06.895615 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 111/215] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:06 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1318 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:07.141545 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e6905584-ea43-4646-9d3b-197e91a0b0da tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:07.142218 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e6905584-ea43-4646-9d3b-197e91a0b0da tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:07.148869 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e6905584-ea43-4646-9d3b-197e91a0b0da tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:07.149307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e6905584-ea43-4646-9d3b-197e91a0b0da tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:07.150069 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e6905584-ea43-4646-9d3b-197e91a0b0da tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:07.150519 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e6905584-ea43-4646-9d3b-197e91a0b0da tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:07.490472 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e6905584-ea43-4646-9d3b-197e91a0b0da tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:07.498068 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e6905584-ea43-4646-9d3b-197e91a0b0da tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.360491 Jun 03 13:04:07.498678 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 105/216] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:07 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:07.914243 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2653ee6e-9e0b-4537-9dee-a64cd09df4c9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:07.915015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2653ee6e-9e0b-4537-9dee-a64cd09df4c9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:07.922144 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2653ee6e-9e0b-4537-9dee-a64cd09df4c9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:07.922607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2653ee6e-9e0b-4537-9dee-a64cd09df4c9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:07.923391 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2653ee6e-9e0b-4537-9dee-a64cd09df4c9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:07.923825 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2653ee6e-9e0b-4537-9dee-a64cd09df4c9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:07.986575 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2653ee6e-9e0b-4537-9dee-a64cd09df4c9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:07.994930 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2653ee6e-9e0b-4537-9dee-a64cd09df4c9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1318 microversion: 2.1 time: 0.085472 Jun 03 13:04:07.995509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 112/217] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:07 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1318 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:08.515258 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d6b1110a-5dec-4303-8ef1-381550db1f0f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:08.515870 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d6b1110a-5dec-4303-8ef1-381550db1f0f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:08.523030 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6b1110a-5dec-4303-8ef1-381550db1f0f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:08.523487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6b1110a-5dec-4303-8ef1-381550db1f0f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:08.524253 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6b1110a-5dec-4303-8ef1-381550db1f0f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:08.524683 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6b1110a-5dec-4303-8ef1-381550db1f0f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:08.660188 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d6b1110a-5dec-4303-8ef1-381550db1f0f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:08.667802 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d6b1110a-5dec-4303-8ef1-381550db1f0f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.156431 Jun 03 13:04:08.668369 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 106/218] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:08 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:09.011976 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5706a134-0d1f-41fd-a1c4-c7909e7856e9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:09.012577 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5706a134-0d1f-41fd-a1c4-c7909e7856e9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:09.019416 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5706a134-0d1f-41fd-a1c4-c7909e7856e9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:09.019796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5706a134-0d1f-41fd-a1c4-c7909e7856e9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:09.021341 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5706a134-0d1f-41fd-a1c4-c7909e7856e9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:09.022101 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5706a134-0d1f-41fd-a1c4-c7909e7856e9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:09.095520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5706a134-0d1f-41fd-a1c4-c7909e7856e9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:09.106314 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5706a134-0d1f-41fd-a1c4-c7909e7856e9 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1318 microversion: 2.1 time: 0.098038 Jun 03 13:04:09.113695 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 113/219] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:09 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1318 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:09.686196 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f5979c82-6c13-488f-88f7-2e1a0497eb62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:09.688173 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f5979c82-6c13-488f-88f7-2e1a0497eb62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:09.705637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5979c82-6c13-488f-88f7-2e1a0497eb62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:09.705902 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5979c82-6c13-488f-88f7-2e1a0497eb62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:09.708704 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5979c82-6c13-488f-88f7-2e1a0497eb62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:09.709276 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f5979c82-6c13-488f-88f7-2e1a0497eb62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:09.890629 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f5979c82-6c13-488f-88f7-2e1a0497eb62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:09.920511 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f5979c82-6c13-488f-88f7-2e1a0497eb62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.239396 Jun 03 13:04:09.924152 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 107/220] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:09 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:10.125364 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-55fcff36-ac41-4289-ad9b-c775f1a75a66 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:10.127149 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-55fcff36-ac41-4289-ad9b-c775f1a75a66 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:10.134299 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55fcff36-ac41-4289-ad9b-c775f1a75a66 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:10.134988 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55fcff36-ac41-4289-ad9b-c775f1a75a66 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:10.135887 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55fcff36-ac41-4289-ad9b-c775f1a75a66 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:10.136444 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-55fcff36-ac41-4289-ad9b-c775f1a75a66 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:10.360097 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-55fcff36-ac41-4289-ad9b-c775f1a75a66 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:10.380457 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-55fcff36-ac41-4289-ad9b-c775f1a75a66 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.259866 Jun 03 13:04:10.385254 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 114/221] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:10 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:10.727405 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-5a245225-2710-4ae8-aaf6-1f32c7c3f9ee req-51e4f6c0-6904-49d9-be5e-897e40f00acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0302f410-973f-4fde-b006-425696dadb3f", "tag": "5eb94fdb-2f92-4409-b6e6-5181bab08551"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:04:10.741543 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-5a245225-2710-4ae8-aaf6-1f32c7c3f9ee req-51e4f6c0-6904-49d9-be5e-897e40f00acb service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:10.742290 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-5a245225-2710-4ae8-aaf6-1f32c7c3f9ee req-51e4f6c0-6904-49d9-be5e-897e40f00acb service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:10.754952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-5a245225-2710-4ae8-aaf6-1f32c7c3f9ee req-51e4f6c0-6904-49d9-be5e-897e40f00acb service nova] Creating event network-changed:5eb94fdb-2f92-4409-b6e6-5181bab08551 for instance 0302f410-973f-4fde-b006-425696dadb3f on hv-cinder-77954 Jun 03 13:04:10.760148 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-5a245225-2710-4ae8-aaf6-1f32c7c3f9ee req-51e4f6c0-6904-49d9-be5e-897e40f00acb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037113 Jun 03 13:04:10.760997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 108/222] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:04:10.941146 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-56df26a8-5cd1-44fb-ab6d-901a02108f6c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:10.941749 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-56df26a8-5cd1-44fb-ab6d-901a02108f6c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:10.948912 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56df26a8-5cd1-44fb-ab6d-901a02108f6c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:10.949359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56df26a8-5cd1-44fb-ab6d-901a02108f6c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:10.950136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56df26a8-5cd1-44fb-ab6d-901a02108f6c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:10.950600 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56df26a8-5cd1-44fb-ab6d-901a02108f6c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:11.090005 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-56df26a8-5cd1-44fb-ab6d-901a02108f6c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:11.097740 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-56df26a8-5cd1-44fb-ab6d-901a02108f6c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.160602 Jun 03 13:04:11.098607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 115/223] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:10 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:11.396192 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:11.396970 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:11.401135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c386ce6c-4634-4b9f-8943-9829d2c7092f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:11.401837 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c386ce6c-4634-4b9f-8943-9829d2c7092f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:11.409183 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c386ce6c-4634-4b9f-8943-9829d2c7092f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:11.409662 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c386ce6c-4634-4b9f-8943-9829d2c7092f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:11.410458 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c386ce6c-4634-4b9f-8943-9829d2c7092f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:11.410929 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c386ce6c-4634-4b9f-8943-9829d2c7092f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:11.425792 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:11.546168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c386ce6c-4634-4b9f-8943-9829d2c7092f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:11.554137 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c386ce6c-4634-4b9f-8943-9829d2c7092f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.159158 Jun 03 13:04:11.554727 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 109/224] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:11 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:12.114612 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fecd7d31-3be1-46ce-853c-a50ae5d2e513 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:12.115294 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fecd7d31-3be1-46ce-853c-a50ae5d2e513 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:12.117398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:12.122864 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fecd7d31-3be1-46ce-853c-a50ae5d2e513 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:12.123316 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fecd7d31-3be1-46ce-853c-a50ae5d2e513 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:12.124287 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fecd7d31-3be1-46ce-853c-a50ae5d2e513 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:12.124586 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fecd7d31-3be1-46ce-853c-a50ae5d2e513 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:12.266641 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fecd7d31-3be1-46ce-853c-a50ae5d2e513 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:12.275008 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fecd7d31-3be1-46ce-853c-a50ae5d2e513 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.164410 Jun 03 13:04:12.275531 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 116/225] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:12 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:12.572197 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c605941b-5cb9-454e-91a9-830d1c9ff920 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:12.572818 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c605941b-5cb9-454e-91a9-830d1c9ff920 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:12.579427 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c605941b-5cb9-454e-91a9-830d1c9ff920 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:12.579879 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c605941b-5cb9-454e-91a9-830d1c9ff920 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:12.580645 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c605941b-5cb9-454e-91a9-830d1c9ff920 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:12.581079 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c605941b-5cb9-454e-91a9-830d1c9ff920 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:12.719995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c605941b-5cb9-454e-91a9-830d1c9ff920 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:12.731972 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c605941b-5cb9-454e-91a9-830d1c9ff920 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.164085 Jun 03 13:04:12.733274 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 110/226] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:12 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:13.290996 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-31e52401-551b-4e60-9b51-36a00869d9a3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:13.291614 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-31e52401-551b-4e60-9b51-36a00869d9a3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:13.297971 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-31e52401-551b-4e60-9b51-36a00869d9a3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:13.298458 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-31e52401-551b-4e60-9b51-36a00869d9a3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:13.299241 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-31e52401-551b-4e60-9b51-36a00869d9a3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:13.299676 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-31e52401-551b-4e60-9b51-36a00869d9a3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:13.437307 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-31e52401-551b-4e60-9b51-36a00869d9a3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:13.449337 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-31e52401-551b-4e60-9b51-36a00869d9a3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.162117 Jun 03 13:04:13.450086 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 117/227] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:13 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:13.752891 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2a2291f5-cd68-4edc-be0c-96187428371c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:13.753787 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2a2291f5-cd68-4edc-be0c-96187428371c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:13.760506 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a2291f5-cd68-4edc-be0c-96187428371c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:13.760979 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a2291f5-cd68-4edc-be0c-96187428371c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:13.761713 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a2291f5-cd68-4edc-be0c-96187428371c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:13.762173 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2a2291f5-cd68-4edc-be0c-96187428371c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:13.908121 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2a2291f5-cd68-4edc-be0c-96187428371c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:13.917608 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2a2291f5-cd68-4edc-be0c-96187428371c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.168642 Jun 03 13:04:13.918246 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 111/228] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:13 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:14.470216 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-03a8d547-bda7-4e0d-87af-fc4bf389d1b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:14.470819 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-03a8d547-bda7-4e0d-87af-fc4bf389d1b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:14.477287 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03a8d547-bda7-4e0d-87af-fc4bf389d1b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:14.477736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03a8d547-bda7-4e0d-87af-fc4bf389d1b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:14.478538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03a8d547-bda7-4e0d-87af-fc4bf389d1b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:14.478969 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03a8d547-bda7-4e0d-87af-fc4bf389d1b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:14.619358 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-03a8d547-bda7-4e0d-87af-fc4bf389d1b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:14.631131 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-03a8d547-bda7-4e0d-87af-fc4bf389d1b9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.164494 Jun 03 13:04:14.631797 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 118/229] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:14 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:14.934699 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7392e78d-a6fa-48fa-b42d-97aa9a81b485 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:14.935569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7392e78d-a6fa-48fa-b42d-97aa9a81b485 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:14.942397 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7392e78d-a6fa-48fa-b42d-97aa9a81b485 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:14.942846 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7392e78d-a6fa-48fa-b42d-97aa9a81b485 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:14.944125 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7392e78d-a6fa-48fa-b42d-97aa9a81b485 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:14.944825 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7392e78d-a6fa-48fa-b42d-97aa9a81b485 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:15.085229 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7392e78d-a6fa-48fa-b42d-97aa9a81b485 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:15.093068 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7392e78d-a6fa-48fa-b42d-97aa9a81b485 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.162240 Jun 03 13:04:15.093793 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 112/230] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:14 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:04:15.651001 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-43c18a17-f77b-4a49-b067-1582b552c208 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:15.651770 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-43c18a17-f77b-4a49-b067-1582b552c208 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:15.658552 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43c18a17-f77b-4a49-b067-1582b552c208 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:15.659001 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43c18a17-f77b-4a49-b067-1582b552c208 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:15.659788 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43c18a17-f77b-4a49-b067-1582b552c208 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:15.660745 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-43c18a17-f77b-4a49-b067-1582b552c208 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:15.663738 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:15.808897 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-43c18a17-f77b-4a49-b067-1582b552c208 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:15.817555 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-43c18a17-f77b-4a49-b067-1582b552c208 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.171739 Jun 03 13:04:15.831432 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 119/231] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:15 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:16.115219 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-51d3cd52-6be1-43bf-80d8-047b0923df87 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:16.116097 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-51d3cd52-6be1-43bf-80d8-047b0923df87 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:16.120102 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:16.129273 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-51d3cd52-6be1-43bf-80d8-047b0923df87 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:16.130015 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-51d3cd52-6be1-43bf-80d8-047b0923df87 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:16.131342 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-51d3cd52-6be1-43bf-80d8-047b0923df87 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:16.132199 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-51d3cd52-6be1-43bf-80d8-047b0923df87 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:16.273294 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-51d3cd52-6be1-43bf-80d8-047b0923df87 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:16.282076 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-51d3cd52-6be1-43bf-80d8-047b0923df87 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.174017 Jun 03 13:04:16.282752 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 113/232] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:16 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:16.837321 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3b695bd2-4424-499f-b897-d80134505048 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:16.837911 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3b695bd2-4424-499f-b897-d80134505048 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:16.844288 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b695bd2-4424-499f-b897-d80134505048 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:16.844994 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b695bd2-4424-499f-b897-d80134505048 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:16.845939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b695bd2-4424-499f-b897-d80134505048 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:16.846565 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b695bd2-4424-499f-b897-d80134505048 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:16.990549 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3b695bd2-4424-499f-b897-d80134505048 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:16.999070 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3b695bd2-4424-499f-b897-d80134505048 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.166294 Jun 03 13:04:17.000261 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 120/233] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:16 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:17.299415 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6aab6655-0fb5-4c8a-a052-3f52fdf4231e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:17.300938 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6aab6655-0fb5-4c8a-a052-3f52fdf4231e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:17.308444 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6aab6655-0fb5-4c8a-a052-3f52fdf4231e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:17.309236 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6aab6655-0fb5-4c8a-a052-3f52fdf4231e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:17.310483 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6aab6655-0fb5-4c8a-a052-3f52fdf4231e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:17.311129 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6aab6655-0fb5-4c8a-a052-3f52fdf4231e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:17.488212 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6aab6655-0fb5-4c8a-a052-3f52fdf4231e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:17.496339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6aab6655-0fb5-4c8a-a052-3f52fdf4231e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.200775 Jun 03 13:04:17.497589 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 114/234] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:17 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:18.019914 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-04413610-754d-4a42-927a-fec553841fc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:18.020919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-04413610-754d-4a42-927a-fec553841fc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:18.023821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:18.029272 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04413610-754d-4a42-927a-fec553841fc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:18.029725 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04413610-754d-4a42-927a-fec553841fc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:18.030606 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04413610-754d-4a42-927a-fec553841fc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:18.031038 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04413610-754d-4a42-927a-fec553841fc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:18.171228 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-04413610-754d-4a42-927a-fec553841fc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:18.178892 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-04413610-754d-4a42-927a-fec553841fc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.165457 Jun 03 13:04:18.179482 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 121/235] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:18 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:18.514712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-995a3a84-b0d9-4d35-bb1e-1c156b20db94 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:18.515294 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-995a3a84-b0d9-4d35-bb1e-1c156b20db94 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:18.522225 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-995a3a84-b0d9-4d35-bb1e-1c156b20db94 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:18.522675 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-995a3a84-b0d9-4d35-bb1e-1c156b20db94 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:18.523845 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-995a3a84-b0d9-4d35-bb1e-1c156b20db94 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:18.524281 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-995a3a84-b0d9-4d35-bb1e-1c156b20db94 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:18.658422 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-995a3a84-b0d9-4d35-bb1e-1c156b20db94 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:18.666180 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-995a3a84-b0d9-4d35-bb1e-1c156b20db94 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.155396 Jun 03 13:04:18.666749 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 115/236] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:18 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:19.196580 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e02824fb-b7ca-467b-a0a4-9a14617542af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:19.197186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e02824fb-b7ca-467b-a0a4-9a14617542af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:19.203722 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e02824fb-b7ca-467b-a0a4-9a14617542af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:19.204176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e02824fb-b7ca-467b-a0a4-9a14617542af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:19.204956 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e02824fb-b7ca-467b-a0a4-9a14617542af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:19.205396 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e02824fb-b7ca-467b-a0a4-9a14617542af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:19.350644 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e02824fb-b7ca-467b-a0a4-9a14617542af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:19.361051 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e02824fb-b7ca-467b-a0a4-9a14617542af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.168636 Jun 03 13:04:19.362015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 122/237] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:19 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:19.706641 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-068153a1-8252-4788-87f5-5dca29c3122f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:19.706641 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-068153a1-8252-4788-87f5-5dca29c3122f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:19.706641 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-068153a1-8252-4788-87f5-5dca29c3122f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:19.706641 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-068153a1-8252-4788-87f5-5dca29c3122f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:19.707433 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-068153a1-8252-4788-87f5-5dca29c3122f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:19.707433 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-068153a1-8252-4788-87f5-5dca29c3122f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:19.870306 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-068153a1-8252-4788-87f5-5dca29c3122f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:19.878134 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-068153a1-8252-4788-87f5-5dca29c3122f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.192854 Jun 03 13:04:19.878764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 116/238] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:19 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:20.380727 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e0a05919-2b33-4994-9022-f60b9b730074 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:20.381318 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e0a05919-2b33-4994-9022-f60b9b730074 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:20.389002 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0a05919-2b33-4994-9022-f60b9b730074 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:20.389574 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0a05919-2b33-4994-9022-f60b9b730074 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:20.390729 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0a05919-2b33-4994-9022-f60b9b730074 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:20.391286 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0a05919-2b33-4994-9022-f60b9b730074 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:20.529237 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e0a05919-2b33-4994-9022-f60b9b730074 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:20.537009 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e0a05919-2b33-4994-9022-f60b9b730074 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.160241 Jun 03 13:04:20.537918 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 123/239] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:20 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:20.896601 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4967d0b7-dc31-4035-8d19-a5db220bd77f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:20.897245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4967d0b7-dc31-4035-8d19-a5db220bd77f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:20.904269 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4967d0b7-dc31-4035-8d19-a5db220bd77f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:20.904721 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4967d0b7-dc31-4035-8d19-a5db220bd77f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:20.905703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4967d0b7-dc31-4035-8d19-a5db220bd77f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:20.906326 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4967d0b7-dc31-4035-8d19-a5db220bd77f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:21.063428 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4967d0b7-dc31-4035-8d19-a5db220bd77f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:21.071347 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4967d0b7-dc31-4035-8d19-a5db220bd77f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.179154 Jun 03 13:04:21.074391 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 117/240] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:20 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:21.555408 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8690b64-b1a8-4674-96ac-1fe04047e9df tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:21.556106 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d8690b64-b1a8-4674-96ac-1fe04047e9df tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:21.562368 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8690b64-b1a8-4674-96ac-1fe04047e9df tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:21.562822 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8690b64-b1a8-4674-96ac-1fe04047e9df tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:21.563611 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8690b64-b1a8-4674-96ac-1fe04047e9df tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:21.564050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8690b64-b1a8-4674-96ac-1fe04047e9df tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:21.727681 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8690b64-b1a8-4674-96ac-1fe04047e9df tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:21.740357 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8690b64-b1a8-4674-96ac-1fe04047e9df tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.188938 Jun 03 13:04:21.741671 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 124/241] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:21 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:22.088765 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7625c571-969b-4e63-ba01-0f4f226747bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:22.089355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7625c571-969b-4e63-ba01-0f4f226747bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:22.096462 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7625c571-969b-4e63-ba01-0f4f226747bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:22.096917 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7625c571-969b-4e63-ba01-0f4f226747bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:22.097688 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7625c571-969b-4e63-ba01-0f4f226747bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:22.098138 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7625c571-969b-4e63-ba01-0f4f226747bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:22.256948 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7625c571-969b-4e63-ba01-0f4f226747bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:22.266337 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7625c571-969b-4e63-ba01-0f4f226747bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.181382 Jun 03 13:04:22.276367 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 118/242] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:22 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:22.759006 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dab94ef0-3d12-44cd-85aa-386ee4f94180 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:22.759959 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dab94ef0-3d12-44cd-85aa-386ee4f94180 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:22.766492 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dab94ef0-3d12-44cd-85aa-386ee4f94180 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:22.766946 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dab94ef0-3d12-44cd-85aa-386ee4f94180 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:22.767723 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dab94ef0-3d12-44cd-85aa-386ee4f94180 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:22.768158 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dab94ef0-3d12-44cd-85aa-386ee4f94180 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:22.900128 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dab94ef0-3d12-44cd-85aa-386ee4f94180 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:22.908449 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dab94ef0-3d12-44cd-85aa-386ee4f94180 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.153440 Jun 03 13:04:22.909308 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 125/243] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:22 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:23.286238 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-09572b43-2f8d-45f5-8b6c-342f17096157 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:23.286821 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-09572b43-2f8d-45f5-8b6c-342f17096157 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:23.296897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09572b43-2f8d-45f5-8b6c-342f17096157 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:23.297439 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09572b43-2f8d-45f5-8b6c-342f17096157 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:23.298645 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09572b43-2f8d-45f5-8b6c-342f17096157 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:23.299216 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09572b43-2f8d-45f5-8b6c-342f17096157 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:23.439846 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-09572b43-2f8d-45f5-8b6c-342f17096157 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:23.447666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-09572b43-2f8d-45f5-8b6c-342f17096157 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.166949 Jun 03 13:04:23.448242 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 119/244] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:23 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:23.927234 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-51fb8d79-3aba-4ea5-bae9-370dad3a7893 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:23.928680 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-51fb8d79-3aba-4ea5-bae9-370dad3a7893 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:23.937650 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51fb8d79-3aba-4ea5-bae9-370dad3a7893 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:23.938129 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51fb8d79-3aba-4ea5-bae9-370dad3a7893 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:23.939279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51fb8d79-3aba-4ea5-bae9-370dad3a7893 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:23.939699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51fb8d79-3aba-4ea5-bae9-370dad3a7893 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:24.080722 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-51fb8d79-3aba-4ea5-bae9-370dad3a7893 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:24.089233 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-51fb8d79-3aba-4ea5-bae9-370dad3a7893 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.166966 Jun 03 13:04:24.090279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 126/245] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:23 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:24.465238 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c425e434-a9b6-49ff-a07d-02712bdc8022 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:24.465862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c425e434-a9b6-49ff-a07d-02712bdc8022 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:24.472358 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c425e434-a9b6-49ff-a07d-02712bdc8022 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:24.472861 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c425e434-a9b6-49ff-a07d-02712bdc8022 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:24.473646 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c425e434-a9b6-49ff-a07d-02712bdc8022 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:24.474258 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c425e434-a9b6-49ff-a07d-02712bdc8022 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:24.668491 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c425e434-a9b6-49ff-a07d-02712bdc8022 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:24.676853 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c425e434-a9b6-49ff-a07d-02712bdc8022 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.215871 Jun 03 13:04:24.678061 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 120/246] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:24 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:25.107663 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3fec2204-8e5d-46d1-ac48-d4d4679078fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:25.108618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3fec2204-8e5d-46d1-ac48-d4d4679078fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:25.114920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3fec2204-8e5d-46d1-ac48-d4d4679078fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:25.115639 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3fec2204-8e5d-46d1-ac48-d4d4679078fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:25.116979 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3fec2204-8e5d-46d1-ac48-d4d4679078fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:25.119424 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3fec2204-8e5d-46d1-ac48-d4d4679078fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:25.326509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3fec2204-8e5d-46d1-ac48-d4d4679078fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:25.337648 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3fec2204-8e5d-46d1-ac48-d4d4679078fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.233831 Jun 03 13:04:25.349555 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 127/247] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:25 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:25.694996 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0be837f5-f305-401e-9616-e7dfbd2a5b78 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:25.695639 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0be837f5-f305-401e-9616-e7dfbd2a5b78 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:25.709696 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0be837f5-f305-401e-9616-e7dfbd2a5b78 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:25.710062 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0be837f5-f305-401e-9616-e7dfbd2a5b78 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:25.710866 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0be837f5-f305-401e-9616-e7dfbd2a5b78 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:25.711298 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0be837f5-f305-401e-9616-e7dfbd2a5b78 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:25.952825 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0be837f5-f305-401e-9616-e7dfbd2a5b78 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:25.964182 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0be837f5-f305-401e-9616-e7dfbd2a5b78 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.272723 Jun 03 13:04:25.967902 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 121/248] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:25 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:26.359958 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7db601ec-e867-4bc4-9017-bfce0a1a4ed8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:26.360672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7db601ec-e867-4bc4-9017-bfce0a1a4ed8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:26.371618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7db601ec-e867-4bc4-9017-bfce0a1a4ed8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:26.372419 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7db601ec-e867-4bc4-9017-bfce0a1a4ed8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:26.373523 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7db601ec-e867-4bc4-9017-bfce0a1a4ed8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:26.374097 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7db601ec-e867-4bc4-9017-bfce0a1a4ed8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:26.631846 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7db601ec-e867-4bc4-9017-bfce0a1a4ed8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:26.659362 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7db601ec-e867-4bc4-9017-bfce0a1a4ed8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.307843 Jun 03 13:04:26.659961 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 128/249] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:26 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:26.985702 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-33f9bf5a-94f7-4308-99ca-e16059208330 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:26.986382 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-33f9bf5a-94f7-4308-99ca-e16059208330 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:26.997926 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-33f9bf5a-94f7-4308-99ca-e16059208330 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:27.002489 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-33f9bf5a-94f7-4308-99ca-e16059208330 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:27.002682 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-33f9bf5a-94f7-4308-99ca-e16059208330 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:27.003315 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-33f9bf5a-94f7-4308-99ca-e16059208330 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:27.424375 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-33f9bf5a-94f7-4308-99ca-e16059208330 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:27.446535 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-33f9bf5a-94f7-4308-99ca-e16059208330 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.465680 Jun 03 13:04:27.451603 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 122/250] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:26 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:27.682283 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-95c83237-c38d-4dfb-bb8d-aa1b1052e097 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:27.683876 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-95c83237-c38d-4dfb-bb8d-aa1b1052e097 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:27.693694 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-95c83237-c38d-4dfb-bb8d-aa1b1052e097 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:27.694813 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-95c83237-c38d-4dfb-bb8d-aa1b1052e097 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:27.695859 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-95c83237-c38d-4dfb-bb8d-aa1b1052e097 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:27.697087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-95c83237-c38d-4dfb-bb8d-aa1b1052e097 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:27.871032 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-95c83237-c38d-4dfb-bb8d-aa1b1052e097 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:27.879959 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-95c83237-c38d-4dfb-bb8d-aa1b1052e097 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.206884 Jun 03 13:04:27.880889 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 129/251] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:27 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:28.468540 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2c7bcfed-a29d-4254-bc67-945cafce8817 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:28.469821 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2c7bcfed-a29d-4254-bc67-945cafce8817 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:28.476557 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c7bcfed-a29d-4254-bc67-945cafce8817 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:28.477197 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c7bcfed-a29d-4254-bc67-945cafce8817 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:28.478182 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c7bcfed-a29d-4254-bc67-945cafce8817 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:28.478781 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2c7bcfed-a29d-4254-bc67-945cafce8817 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:28.646090 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2c7bcfed-a29d-4254-bc67-945cafce8817 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:28.655647 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2c7bcfed-a29d-4254-bc67-945cafce8817 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.192487 Jun 03 13:04:28.656348 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 123/252] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:28 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:28.908911 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a2f18cd7-2bbd-47ca-a257-7e6d7388bbc6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:28.913346 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a2f18cd7-2bbd-47ca-a257-7e6d7388bbc6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:28.939635 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a2f18cd7-2bbd-47ca-a257-7e6d7388bbc6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:28.945295 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a2f18cd7-2bbd-47ca-a257-7e6d7388bbc6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:28.946887 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a2f18cd7-2bbd-47ca-a257-7e6d7388bbc6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:28.947470 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a2f18cd7-2bbd-47ca-a257-7e6d7388bbc6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:29.197078 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a2f18cd7-2bbd-47ca-a257-7e6d7388bbc6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:29.210524 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a2f18cd7-2bbd-47ca-a257-7e6d7388bbc6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.317106 Jun 03 13:04:29.213244 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 130/253] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:28 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:29.673685 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9be277eb-c673-4699-9642-097bbf5d59d2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:29.674473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9be277eb-c673-4699-9642-097bbf5d59d2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:29.682191 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9be277eb-c673-4699-9642-097bbf5d59d2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:29.682710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9be277eb-c673-4699-9642-097bbf5d59d2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:29.683671 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9be277eb-c673-4699-9642-097bbf5d59d2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:29.684294 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9be277eb-c673-4699-9642-097bbf5d59d2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:29.860203 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9be277eb-c673-4699-9642-097bbf5d59d2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:29.873600 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9be277eb-c673-4699-9642-097bbf5d59d2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.203542 Jun 03 13:04:29.874247 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 124/254] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:29 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:30.230735 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fd9c8629-ed6e-4a36-bd21-f34fcfaf9be0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:30.231360 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fd9c8629-ed6e-4a36-bd21-f34fcfaf9be0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:30.239109 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd9c8629-ed6e-4a36-bd21-f34fcfaf9be0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:30.239881 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd9c8629-ed6e-4a36-bd21-f34fcfaf9be0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:30.240930 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd9c8629-ed6e-4a36-bd21-f34fcfaf9be0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:30.241790 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd9c8629-ed6e-4a36-bd21-f34fcfaf9be0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:30.388794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fd9c8629-ed6e-4a36-bd21-f34fcfaf9be0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:30.397059 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fd9c8629-ed6e-4a36-bd21-f34fcfaf9be0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.171476 Jun 03 13:04:30.397842 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 131/255] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:30 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:30.892243 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ec70104e-e94f-4015-9803-a698d564f6df tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:30.892926 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ec70104e-e94f-4015-9803-a698d564f6df tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:30.904518 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec70104e-e94f-4015-9803-a698d564f6df tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:30.906731 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec70104e-e94f-4015-9803-a698d564f6df tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:30.908778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec70104e-e94f-4015-9803-a698d564f6df tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:30.910693 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec70104e-e94f-4015-9803-a698d564f6df tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:31.097493 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ec70104e-e94f-4015-9803-a698d564f6df tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:31.106077 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ec70104e-e94f-4015-9803-a698d564f6df tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.218090 Jun 03 13:04:31.116722 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 125/256] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:30 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:31.414959 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fc92d13b-347f-43f2-b8ab-6c889dff2df0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:31.416209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fc92d13b-347f-43f2-b8ab-6c889dff2df0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:31.422371 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc92d13b-347f-43f2-b8ab-6c889dff2df0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:31.422828 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc92d13b-347f-43f2-b8ab-6c889dff2df0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:31.423606 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc92d13b-347f-43f2-b8ab-6c889dff2df0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:31.424040 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc92d13b-347f-43f2-b8ab-6c889dff2df0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:31.581903 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fc92d13b-347f-43f2-b8ab-6c889dff2df0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:31.590948 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fc92d13b-347f-43f2-b8ab-6c889dff2df0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1520 microversion: 2.1 time: 0.179867 Jun 03 13:04:31.592512 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 132/257] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:31 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:32.123868 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7b3a59ab-16cf-4c45-be57-557232d923ce tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:32.124580 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7b3a59ab-16cf-4c45-be57-557232d923ce tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:32.137742 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7b3a59ab-16cf-4c45-be57-557232d923ce tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:32.138225 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7b3a59ab-16cf-4c45-be57-557232d923ce tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:32.139055 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7b3a59ab-16cf-4c45-be57-557232d923ce tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:32.139487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7b3a59ab-16cf-4c45-be57-557232d923ce tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:32.144833 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:32.320945 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7b3a59ab-16cf-4c45-be57-557232d923ce tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:32.329479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7b3a59ab-16cf-4c45-be57-557232d923ce tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.209579 Jun 03 13:04:32.331182 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 126/258] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:32 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:32.610776 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-57e6a580-885e-4ea1-b184-eb13c07de80d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:32.612088 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-57e6a580-885e-4ea1-b184-eb13c07de80d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:32.624938 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57e6a580-885e-4ea1-b184-eb13c07de80d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:32.625525 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57e6a580-885e-4ea1-b184-eb13c07de80d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:32.627129 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57e6a580-885e-4ea1-b184-eb13c07de80d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:32.627665 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-57e6a580-885e-4ea1-b184-eb13c07de80d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:32.779718 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-57e6a580-885e-4ea1-b184-eb13c07de80d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:32.789989 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-57e6a580-885e-4ea1-b184-eb13c07de80d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1500 microversion: 2.1 time: 0.184889 Jun 03 13:04:32.794380 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 133/259] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:32 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1500 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:32.810029 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8165cb45-02b0-4aed-b9e1-2a3ce144736f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:32.810753 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8165cb45-02b0-4aed-b9e1-2a3ce144736f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:32.818954 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8165cb45-02b0-4aed-b9e1-2a3ce144736f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:32.820270 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8165cb45-02b0-4aed-b9e1-2a3ce144736f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:32.821377 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8165cb45-02b0-4aed-b9e1-2a3ce144736f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:32.822143 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8165cb45-02b0-4aed-b9e1-2a3ce144736f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:33.016087 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8165cb45-02b0-4aed-b9e1-2a3ce144736f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:33.023954 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8165cb45-02b0-4aed-b9e1-2a3ce144736f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1516 microversion: 2.1 time: 0.218536 Jun 03 13:04:33.024588 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 127/260] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:32 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:33.348222 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-271d4380-db83-4eb7-8751-060b29c5eae4 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:33.349138 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-271d4380-db83-4eb7-8751-060b29c5eae4 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:33.359525 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-271d4380-db83-4eb7-8751-060b29c5eae4 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:33.360276 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-271d4380-db83-4eb7-8751-060b29c5eae4 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:33.361407 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-271d4380-db83-4eb7-8751-060b29c5eae4 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:33.362250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-271d4380-db83-4eb7-8751-060b29c5eae4 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:33.687091 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-271d4380-db83-4eb7-8751-060b29c5eae4 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:33.699598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-271d4380-db83-4eb7-8751-060b29c5eae4 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.355615 Jun 03 13:04:33.702810 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 134/261] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:33 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:34.664199 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-67df445b-3ec7-43a3-9fff-b57687968379 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:04:34.666093 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-67df445b-3ec7-43a3-9fff-b57687968379 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:34.678803 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-67df445b-3ec7-43a3-9fff-b57687968379 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:34.681058 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-67df445b-3ec7-43a3-9fff-b57687968379 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:34.682036 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-67df445b-3ec7-43a3-9fff-b57687968379 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:34.684702 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-67df445b-3ec7-43a3-9fff-b57687968379 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:34.721447 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6c50bdd0-be73-492b-ad97-084aafc98a81 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:34.722053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6c50bdd0-be73-492b-ad97-084aafc98a81 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:34.728605 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6c50bdd0-be73-492b-ad97-084aafc98a81 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:34.728986 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6c50bdd0-be73-492b-ad97-084aafc98a81 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:34.735568 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6c50bdd0-be73-492b-ad97-084aafc98a81 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:34.735568 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6c50bdd0-be73-492b-ad97-084aafc98a81 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:34.751511 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-67df445b-3ec7-43a3-9fff-b57687968379 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lazy-loading 'flavor' on Instance uuid 8810fcf9-5763-45c2-9e84-9a12f2fa1447 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:04:34.896254 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-67df445b-3ec7-43a3-9fff-b57687968379 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "POST /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447/action" status: 200 len: 32 microversion: 2.1 time: 0.236525 Jun 03 13:04:34.903986 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 128/262] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:04:34 2022] POST /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:04:34.913291 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c74a105f-8bcb-4243-896f-5e9490abc826 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:34.914306 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c74a105f-8bcb-4243-896f-5e9490abc826 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:34.921867 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c74a105f-8bcb-4243-896f-5e9490abc826 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:34.922687 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c74a105f-8bcb-4243-896f-5e9490abc826 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:34.923683 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c74a105f-8bcb-4243-896f-5e9490abc826 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:34.924405 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c74a105f-8bcb-4243-896f-5e9490abc826 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:34.941504 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6c50bdd0-be73-492b-ad97-084aafc98a81 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:34.943871 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:34.953931 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6c50bdd0-be73-492b-ad97-084aafc98a81 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.236963 Jun 03 13:04:34.954980 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 135/263] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:34 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:35.113381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c74a105f-8bcb-4243-896f-5e9490abc826 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:35.122936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c74a105f-8bcb-4243-896f-5e9490abc826 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.217347 Jun 03 13:04:35.126165 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 129/264] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:34 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:04:35.973183 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-db232dcf-df61-4545-ab41-e20b5d3dc62a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:35.973827 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-db232dcf-df61-4545-ab41-e20b5d3dc62a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:35.981136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-db232dcf-df61-4545-ab41-e20b5d3dc62a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:35.981584 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-db232dcf-df61-4545-ab41-e20b5d3dc62a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:35.982387 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-db232dcf-df61-4545-ab41-e20b5d3dc62a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:35.982848 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-db232dcf-df61-4545-ab41-e20b5d3dc62a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:36.126170 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-db232dcf-df61-4545-ab41-e20b5d3dc62a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:36.137031 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-db232dcf-df61-4545-ab41-e20b5d3dc62a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.169342 Jun 03 13:04:36.138240 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 136/265] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:35 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:36.152886 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fad23b7e-1b8d-4d81-a13b-db4b18ae837d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:36.153494 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fad23b7e-1b8d-4d81-a13b-db4b18ae837d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:36.160281 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fad23b7e-1b8d-4d81-a13b-db4b18ae837d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:36.160724 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fad23b7e-1b8d-4d81-a13b-db4b18ae837d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:36.161489 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fad23b7e-1b8d-4d81-a13b-db4b18ae837d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:36.161922 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fad23b7e-1b8d-4d81-a13b-db4b18ae837d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:36.324078 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fad23b7e-1b8d-4d81-a13b-db4b18ae837d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:36.333252 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fad23b7e-1b8d-4d81-a13b-db4b18ae837d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.186401 Jun 03 13:04:36.333839 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 130/266] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:36 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:37.160028 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f58c297-9fb5-4e6b-beb1-4dd7eb74773b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:37.161414 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f58c297-9fb5-4e6b-beb1-4dd7eb74773b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:37.170666 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f58c297-9fb5-4e6b-beb1-4dd7eb74773b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:37.171107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f58c297-9fb5-4e6b-beb1-4dd7eb74773b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:37.171961 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f58c297-9fb5-4e6b-beb1-4dd7eb74773b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:37.172408 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f58c297-9fb5-4e6b-beb1-4dd7eb74773b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:37.321134 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f58c297-9fb5-4e6b-beb1-4dd7eb74773b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:37.321134 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f58c297-9fb5-4e6b-beb1-4dd7eb74773b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.167778 Jun 03 13:04:37.321817 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 137/267] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:37 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:37.351462 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cd449a9c-ee2e-40fb-a66b-4bdbacdd7b68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:37.352153 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cd449a9c-ee2e-40fb-a66b-4bdbacdd7b68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:37.359865 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd449a9c-ee2e-40fb-a66b-4bdbacdd7b68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:37.360411 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd449a9c-ee2e-40fb-a66b-4bdbacdd7b68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:37.361152 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd449a9c-ee2e-40fb-a66b-4bdbacdd7b68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:37.361648 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd449a9c-ee2e-40fb-a66b-4bdbacdd7b68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:37.503242 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cd449a9c-ee2e-40fb-a66b-4bdbacdd7b68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:37.511453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cd449a9c-ee2e-40fb-a66b-4bdbacdd7b68 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.163810 Jun 03 13:04:37.512033 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 131/268] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:37 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:38.338046 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-819be528-1065-4024-b00d-5d80d60cf4b1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:38.339432 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-819be528-1065-4024-b00d-5d80d60cf4b1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:38.347128 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-819be528-1065-4024-b00d-5d80d60cf4b1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:38.347582 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-819be528-1065-4024-b00d-5d80d60cf4b1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:38.349386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-819be528-1065-4024-b00d-5d80d60cf4b1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:38.349851 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-819be528-1065-4024-b00d-5d80d60cf4b1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:38.514802 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-819be528-1065-4024-b00d-5d80d60cf4b1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:38.527624 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-819be528-1065-4024-b00d-5d80d60cf4b1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.189740 Jun 03 13:04:38.527624 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 138/269] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:38 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:38.531021 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3f006417-726f-441b-aebf-1cb140e4c71d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:38.532047 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3f006417-726f-441b-aebf-1cb140e4c71d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:38.539831 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f006417-726f-441b-aebf-1cb140e4c71d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:38.541160 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f006417-726f-441b-aebf-1cb140e4c71d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:38.542322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f006417-726f-441b-aebf-1cb140e4c71d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:38.543028 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3f006417-726f-441b-aebf-1cb140e4c71d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:38.751619 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3f006417-726f-441b-aebf-1cb140e4c71d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:38.762097 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3f006417-726f-441b-aebf-1cb140e4c71d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.235433 Jun 03 13:04:38.762924 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 132/270] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:38 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:04:39.543506 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8af797f2-92cc-43b6-b9bd-056ca53fd68e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:39.545040 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8af797f2-92cc-43b6-b9bd-056ca53fd68e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:39.552372 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8af797f2-92cc-43b6-b9bd-056ca53fd68e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:39.552905 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8af797f2-92cc-43b6-b9bd-056ca53fd68e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:39.553762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8af797f2-92cc-43b6-b9bd-056ca53fd68e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:39.554235 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8af797f2-92cc-43b6-b9bd-056ca53fd68e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:39.706642 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8af797f2-92cc-43b6-b9bd-056ca53fd68e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:39.715976 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8af797f2-92cc-43b6-b9bd-056ca53fd68e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.177006 Jun 03 13:04:39.716671 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 139/271] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:39 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:39.787540 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0436210b-a1df-4173-b8f0-33371f6fdacf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:39.788883 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0436210b-a1df-4173-b8f0-33371f6fdacf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:39.796613 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0436210b-a1df-4173-b8f0-33371f6fdacf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:39.797083 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0436210b-a1df-4173-b8f0-33371f6fdacf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:39.797843 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0436210b-a1df-4173-b8f0-33371f6fdacf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:39.798306 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0436210b-a1df-4173-b8f0-33371f6fdacf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:39.986601 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0436210b-a1df-4173-b8f0-33371f6fdacf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:39.997587 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0436210b-a1df-4173-b8f0-33371f6fdacf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.213837 Jun 03 13:04:39.998206 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 133/272] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:39 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:40.734322 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e2f37d4c-f083-4104-8ea3-361fe1dac1ca tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:40.735003 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e2f37d4c-f083-4104-8ea3-361fe1dac1ca tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:40.742022 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e2f37d4c-f083-4104-8ea3-361fe1dac1ca tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:40.742508 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e2f37d4c-f083-4104-8ea3-361fe1dac1ca tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:40.751926 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e2f37d4c-f083-4104-8ea3-361fe1dac1ca tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:40.752371 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e2f37d4c-f083-4104-8ea3-361fe1dac1ca tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:40.949184 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e2f37d4c-f083-4104-8ea3-361fe1dac1ca tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:40.966450 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e2f37d4c-f083-4104-8ea3-361fe1dac1ca tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.237716 Jun 03 13:04:40.967360 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 140/273] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:40 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:41.017817 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1b136689-cc97-4885-9346-e511ffefc46b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:41.018520 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1b136689-cc97-4885-9346-e511ffefc46b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:41.038332 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b136689-cc97-4885-9346-e511ffefc46b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:41.038777 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b136689-cc97-4885-9346-e511ffefc46b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:41.039545 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b136689-cc97-4885-9346-e511ffefc46b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:41.041227 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1b136689-cc97-4885-9346-e511ffefc46b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:41.274249 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1b136689-cc97-4885-9346-e511ffefc46b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:41.284362 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1b136689-cc97-4885-9346-e511ffefc46b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.270810 Jun 03 13:04:41.292846 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 134/274] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:41 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:41.983952 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b8b5b24a-6d32-46a0-a326-e490fa26e1c1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:41.984560 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b8b5b24a-6d32-46a0-a326-e490fa26e1c1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:41.990839 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b8b5b24a-6d32-46a0-a326-e490fa26e1c1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:41.991262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b8b5b24a-6d32-46a0-a326-e490fa26e1c1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:41.992026 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b8b5b24a-6d32-46a0-a326-e490fa26e1c1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:41.992658 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b8b5b24a-6d32-46a0-a326-e490fa26e1c1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:42.131615 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b8b5b24a-6d32-46a0-a326-e490fa26e1c1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:42.139579 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b8b5b24a-6d32-46a0-a326-e490fa26e1c1 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.159986 Jun 03 13:04:42.140155 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 141/275] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:41 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:42.307963 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0d4fc9b3-c669-4003-82a0-025c4067fa8f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:42.308961 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0d4fc9b3-c669-4003-82a0-025c4067fa8f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:42.320171 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d4fc9b3-c669-4003-82a0-025c4067fa8f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:42.320903 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d4fc9b3-c669-4003-82a0-025c4067fa8f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:42.322032 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d4fc9b3-c669-4003-82a0-025c4067fa8f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:42.322494 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d4fc9b3-c669-4003-82a0-025c4067fa8f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:42.465677 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0d4fc9b3-c669-4003-82a0-025c4067fa8f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:42.474334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0d4fc9b3-c669-4003-82a0-025c4067fa8f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.173142 Jun 03 13:04:42.475061 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 135/276] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:42 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:42.636744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-2eb2ed9c-baa8-44a3-ba1f-0d7a6255f1cf req-dcb8dc1d-b992-4818-ad71-77a20f173186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0302f410-973f-4fde-b006-425696dadb3f", "name": "network-vif-plugged", "status": "completed", "tag": "5eb94fdb-2f92-4409-b6e6-5181bab08551"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:04:42.645069 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-2eb2ed9c-baa8-44a3-ba1f-0d7a6255f1cf req-dcb8dc1d-b992-4818-ad71-77a20f173186 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:42.645686 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-2eb2ed9c-baa8-44a3-ba1f-0d7a6255f1cf req-dcb8dc1d-b992-4818-ad71-77a20f173186 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:42.657578 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-2eb2ed9c-baa8-44a3-ba1f-0d7a6255f1cf req-dcb8dc1d-b992-4818-ad71-77a20f173186 service nova] Creating event network-vif-plugged:5eb94fdb-2f92-4409-b6e6-5181bab08551 for instance 0302f410-973f-4fde-b006-425696dadb3f on hv-cinder-77954 Jun 03 13:04:42.662585 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-2eb2ed9c-baa8-44a3-ba1f-0d7a6255f1cf req-dcb8dc1d-b992-4818-ad71-77a20f173186 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030227 Jun 03 13:04:42.663183 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 142/277] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:04:43.159134 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-026842e0-fb60-49de-84eb-e38800019fbc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:43.159779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-026842e0-fb60-49de-84eb-e38800019fbc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:43.166279 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-026842e0-fb60-49de-84eb-e38800019fbc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:43.166732 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-026842e0-fb60-49de-84eb-e38800019fbc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:43.167502 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-026842e0-fb60-49de-84eb-e38800019fbc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:43.167935 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-026842e0-fb60-49de-84eb-e38800019fbc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:43.302537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-026842e0-fb60-49de-84eb-e38800019fbc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:43.310707 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-026842e0-fb60-49de-84eb-e38800019fbc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.155160 Jun 03 13:04:43.311378 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 136/278] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:43 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:43.494452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ac722cfd-0731-4242-8ea0-806a0b3105fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:43.495320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ac722cfd-0731-4242-8ea0-806a0b3105fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:43.502142 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac722cfd-0731-4242-8ea0-806a0b3105fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:43.502615 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac722cfd-0731-4242-8ea0-806a0b3105fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:43.503453 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac722cfd-0731-4242-8ea0-806a0b3105fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:43.503893 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ac722cfd-0731-4242-8ea0-806a0b3105fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:43.840751 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ac722cfd-0731-4242-8ea0-806a0b3105fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:43.852974 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ac722cfd-0731-4242-8ea0-806a0b3105fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.363220 Jun 03 13:04:43.853549 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 143/279] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:43 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:44.331420 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ea6c73d6-0d16-4047-bddf-3725960d40b7 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:44.332087 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ea6c73d6-0d16-4047-bddf-3725960d40b7 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:44.340284 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea6c73d6-0d16-4047-bddf-3725960d40b7 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:44.340721 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea6c73d6-0d16-4047-bddf-3725960d40b7 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:44.341482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea6c73d6-0d16-4047-bddf-3725960d40b7 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:44.341905 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea6c73d6-0d16-4047-bddf-3725960d40b7 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:44.472291 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ea6c73d6-0d16-4047-bddf-3725960d40b7 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:44.479964 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ea6c73d6-0d16-4047-bddf-3725960d40b7 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.154695 Jun 03 13:04:44.480539 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 137/280] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:44 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:44.873903 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-056c6237-d1eb-4e37-9e81-57146f05164f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:44.874914 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-056c6237-d1eb-4e37-9e81-57146f05164f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:44.882836 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-056c6237-d1eb-4e37-9e81-57146f05164f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:44.883435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-056c6237-d1eb-4e37-9e81-57146f05164f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:44.884615 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-056c6237-d1eb-4e37-9e81-57146f05164f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:44.885193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-056c6237-d1eb-4e37-9e81-57146f05164f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:45.028342 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-056c6237-d1eb-4e37-9e81-57146f05164f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:45.039844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-056c6237-d1eb-4e37-9e81-57146f05164f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.171496 Jun 03 13:04:45.040581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 144/281] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:44 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:45.497487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-40f5a4b3-6fd2-44e3-bf35-390cef182352 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:45.498237 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-40f5a4b3-6fd2-44e3-bf35-390cef182352 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:45.505194 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-40f5a4b3-6fd2-44e3-bf35-390cef182352 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:45.505641 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-40f5a4b3-6fd2-44e3-bf35-390cef182352 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:45.506544 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-40f5a4b3-6fd2-44e3-bf35-390cef182352 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:45.507053 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-40f5a4b3-6fd2-44e3-bf35-390cef182352 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:45.647407 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-40f5a4b3-6fd2-44e3-bf35-390cef182352 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:45.655452 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-40f5a4b3-6fd2-44e3-bf35-390cef182352 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.162317 Jun 03 13:04:45.656017 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 138/282] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:45 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:46.061913 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dec1e610-db9c-4943-b5c2-45c784e29774 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:46.062811 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dec1e610-db9c-4943-b5c2-45c784e29774 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:46.072689 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dec1e610-db9c-4943-b5c2-45c784e29774 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:46.073142 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dec1e610-db9c-4943-b5c2-45c784e29774 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:46.073908 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dec1e610-db9c-4943-b5c2-45c784e29774 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:46.074387 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dec1e610-db9c-4943-b5c2-45c784e29774 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:46.206174 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dec1e610-db9c-4943-b5c2-45c784e29774 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:46.218052 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dec1e610-db9c-4943-b5c2-45c784e29774 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.163028 Jun 03 13:04:46.218918 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 145/283] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:46 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:46.673339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cc919077-2184-4e8f-b465-cc2b8c449067 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:46.674019 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cc919077-2184-4e8f-b465-cc2b8c449067 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:46.676773 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=52 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:46.683174 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cc919077-2184-4e8f-b465-cc2b8c449067 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:46.683670 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cc919077-2184-4e8f-b465-cc2b8c449067 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:46.684523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cc919077-2184-4e8f-b465-cc2b8c449067 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:46.685000 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cc919077-2184-4e8f-b465-cc2b8c449067 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:46.817415 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cc919077-2184-4e8f-b465-cc2b8c449067 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:46.825361 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cc919077-2184-4e8f-b465-cc2b8c449067 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.156372 Jun 03 13:04:46.825928 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 139/284] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:46 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:47.243584 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2c94188f-4e32-41c6-a464-d778915a9d45 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:47.244451 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2c94188f-4e32-41c6-a464-d778915a9d45 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:47.251468 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2c94188f-4e32-41c6-a464-d778915a9d45 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:47.251955 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2c94188f-4e32-41c6-a464-d778915a9d45 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:47.252771 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2c94188f-4e32-41c6-a464-d778915a9d45 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:47.253234 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2c94188f-4e32-41c6-a464-d778915a9d45 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:47.397290 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2c94188f-4e32-41c6-a464-d778915a9d45 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:47.406830 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2c94188f-4e32-41c6-a464-d778915a9d45 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.169810 Jun 03 13:04:47.407429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 146/285] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:47 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:47.841407 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-05a61ff8-5b5e-4b74-8ae3-d5240b5be7d0 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:47.842032 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-05a61ff8-5b5e-4b74-8ae3-d5240b5be7d0 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:47.848695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05a61ff8-5b5e-4b74-8ae3-d5240b5be7d0 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:47.849141 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05a61ff8-5b5e-4b74-8ae3-d5240b5be7d0 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:47.849939 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05a61ff8-5b5e-4b74-8ae3-d5240b5be7d0 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:47.850400 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05a61ff8-5b5e-4b74-8ae3-d5240b5be7d0 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:47.982681 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-05a61ff8-5b5e-4b74-8ae3-d5240b5be7d0 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:47.986325 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:47.994371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-05a61ff8-5b5e-4b74-8ae3-d5240b5be7d0 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.156605 Jun 03 13:04:47.995028 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 140/286] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:47 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:48.432665 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b0b277cb-1809-45b1-8867-b50ebb6f2055 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:48.433681 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b0b277cb-1809-45b1-8867-b50ebb6f2055 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:48.436850 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=52 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:48.445192 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0b277cb-1809-45b1-8867-b50ebb6f2055 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:48.445989 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0b277cb-1809-45b1-8867-b50ebb6f2055 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:48.447494 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0b277cb-1809-45b1-8867-b50ebb6f2055 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:48.448404 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0b277cb-1809-45b1-8867-b50ebb6f2055 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:48.594547 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b0b277cb-1809-45b1-8867-b50ebb6f2055 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:48.602642 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b0b277cb-1809-45b1-8867-b50ebb6f2055 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.177201 Jun 03 13:04:48.603213 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 147/287] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:48 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:49.011259 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a4c8a08e-e9e7-4016-9724-cf2c34b6fb9d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:49.011836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a4c8a08e-e9e7-4016-9724-cf2c34b6fb9d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:49.019346 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4c8a08e-e9e7-4016-9724-cf2c34b6fb9d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:49.019792 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4c8a08e-e9e7-4016-9724-cf2c34b6fb9d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:49.020561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4c8a08e-e9e7-4016-9724-cf2c34b6fb9d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:49.021013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a4c8a08e-e9e7-4016-9724-cf2c34b6fb9d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:49.156337 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a4c8a08e-e9e7-4016-9724-cf2c34b6fb9d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:49.164114 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a4c8a08e-e9e7-4016-9724-cf2c34b6fb9d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.157129 Jun 03 13:04:49.164671 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 141/288] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:49 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:49.620881 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-919d4831-8b19-4ae2-b6d1-90ccc68e38c1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:49.622272 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-919d4831-8b19-4ae2-b6d1-90ccc68e38c1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:49.630140 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-919d4831-8b19-4ae2-b6d1-90ccc68e38c1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:49.630625 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-919d4831-8b19-4ae2-b6d1-90ccc68e38c1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:49.631418 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-919d4831-8b19-4ae2-b6d1-90ccc68e38c1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:49.631857 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-919d4831-8b19-4ae2-b6d1-90ccc68e38c1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:49.772165 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-919d4831-8b19-4ae2-b6d1-90ccc68e38c1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:49.780130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-919d4831-8b19-4ae2-b6d1-90ccc68e38c1 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.164598 Jun 03 13:04:49.780670 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 148/289] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:49 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:50.181024 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-44c4a9a6-aec0-4dac-9102-009e159b10bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:50.181749 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-44c4a9a6-aec0-4dac-9102-009e159b10bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:50.190522 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-44c4a9a6-aec0-4dac-9102-009e159b10bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:50.190984 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-44c4a9a6-aec0-4dac-9102-009e159b10bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:50.191740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-44c4a9a6-aec0-4dac-9102-009e159b10bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:50.192426 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-44c4a9a6-aec0-4dac-9102-009e159b10bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:50.384966 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-44c4a9a6-aec0-4dac-9102-009e159b10bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:50.395400 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-44c4a9a6-aec0-4dac-9102-009e159b10bd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1358 microversion: 2.1 time: 0.218171 Jun 03 13:04:50.396189 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 142/290] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:50 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:50.801701 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-842d5363-ebb0-4abd-be2f-8b4f934eb745 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:50.802691 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-842d5363-ebb0-4abd-be2f-8b4f934eb745 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:50.811781 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-842d5363-ebb0-4abd-be2f-8b4f934eb745 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:50.812234 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-842d5363-ebb0-4abd-be2f-8b4f934eb745 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:50.813002 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-842d5363-ebb0-4abd-be2f-8b4f934eb745 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:50.813476 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-842d5363-ebb0-4abd-be2f-8b4f934eb745 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:50.949546 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-842d5363-ebb0-4abd-be2f-8b4f934eb745 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:50.957805 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-842d5363-ebb0-4abd-be2f-8b4f934eb745 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.162711 Jun 03 13:04:50.958420 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 149/291] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:50 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:51.416307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cd8bdf82-96a9-4aa5-8c29-be95d2c02fc2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:51.416850 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cd8bdf82-96a9-4aa5-8c29-be95d2c02fc2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:51.423996 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd8bdf82-96a9-4aa5-8c29-be95d2c02fc2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:51.424438 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd8bdf82-96a9-4aa5-8c29-be95d2c02fc2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:51.425205 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd8bdf82-96a9-4aa5-8c29-be95d2c02fc2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:51.425632 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cd8bdf82-96a9-4aa5-8c29-be95d2c02fc2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:51.567805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cd8bdf82-96a9-4aa5-8c29-be95d2c02fc2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:51.576063 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cd8bdf82-96a9-4aa5-8c29-be95d2c02fc2 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1548 microversion: 2.1 time: 0.164340 Jun 03 13:04:51.576742 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 143/292] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:51 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:51.592993 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2d809fd1-2c5b-4026-9c5e-9390127e0055 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:51.593609 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2d809fd1-2c5b-4026-9c5e-9390127e0055 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:51.600095 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d809fd1-2c5b-4026-9c5e-9390127e0055 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:51.600538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d809fd1-2c5b-4026-9c5e-9390127e0055 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:51.601305 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d809fd1-2c5b-4026-9c5e-9390127e0055 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:51.601734 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d809fd1-2c5b-4026-9c5e-9390127e0055 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:51.741175 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2d809fd1-2c5b-4026-9c5e-9390127e0055 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:51.749071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2d809fd1-2c5b-4026-9c5e-9390127e0055 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1548 microversion: 2.1 time: 0.160291 Jun 03 13:04:51.749643 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 150/293] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:51 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:51.765050 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-887647d3-7e0e-452b-a01f-006c2f3f84cc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:51.768479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-887647d3-7e0e-452b-a01f-006c2f3f84cc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:51.769355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-887647d3-7e0e-452b-a01f-006c2f3f84cc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Searching by: {'deleted': False, 'project_id': '80d06506691e4947b14192431bed4453'} {{(pid=117726) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 03 13:04:51.776543 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-887647d3-7e0e-452b-a01f-006c2f3f84cc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:51.777206 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-887647d3-7e0e-452b-a01f-006c2f3f84cc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:51.778016 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-887647d3-7e0e-452b-a01f-006c2f3f84cc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:51.778488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-887647d3-7e0e-452b-a01f-006c2f3f84cc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:51.867981 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.multi_cell_list [None req-887647d3-7e0e-452b-a01f-006c2f3f84cc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 03 13:04:51.959810 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-887647d3-7e0e-452b-a01f-006c2f3f84cc tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.198647 Jun 03 13:04:51.960435 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 144/294] 10.222.0.58 () {58 vars in 1124 bytes} [Fri Jun 3 13:04:51 2022] GET /compute/v2.1/servers => generated 342 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:04:51.971593 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-42ae9af5-b31e-4bd2-83df-e2e09cd04ac5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:51.972820 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-42ae9af5-b31e-4bd2-83df-e2e09cd04ac5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:51.975441 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-eed32833-47d1-4b7f-a0e3-3a8cb69ea73f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:51.976050 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-eed32833-47d1-4b7f-a0e3-3a8cb69ea73f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:51.979340 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42ae9af5-b31e-4bd2-83df-e2e09cd04ac5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:51.979791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42ae9af5-b31e-4bd2-83df-e2e09cd04ac5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:51.981265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42ae9af5-b31e-4bd2-83df-e2e09cd04ac5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:51.981705 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-42ae9af5-b31e-4bd2-83df-e2e09cd04ac5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:51.982450 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eed32833-47d1-4b7f-a0e3-3a8cb69ea73f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:51.982949 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eed32833-47d1-4b7f-a0e3-3a8cb69ea73f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:51.984193 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eed32833-47d1-4b7f-a0e3-3a8cb69ea73f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:51.984845 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eed32833-47d1-4b7f-a0e3-3a8cb69ea73f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:52.177213 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-42ae9af5-b31e-4bd2-83df-e2e09cd04ac5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:52.181015 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-eed32833-47d1-4b7f-a0e3-3a8cb69ea73f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:52.185248 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-42ae9af5-b31e-4bd2-83df-e2e09cd04ac5 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1548 microversion: 2.1 time: 0.217725 Jun 03 13:04:52.189461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 151/295] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:51 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1548 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:52.189605 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-eed32833-47d1-4b7f-a0e3-3a8cb69ea73f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.217366 Jun 03 13:04:52.189605 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 145/296] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:51 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:53.209048 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ee5ef0a9-e1ea-4886-aa50-4e57ae7c3958 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:53.209975 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ee5ef0a9-e1ea-4886-aa50-4e57ae7c3958 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:53.218497 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee5ef0a9-e1ea-4886-aa50-4e57ae7c3958 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:53.218954 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee5ef0a9-e1ea-4886-aa50-4e57ae7c3958 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:53.219735 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee5ef0a9-e1ea-4886-aa50-4e57ae7c3958 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:53.220172 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee5ef0a9-e1ea-4886-aa50-4e57ae7c3958 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:53.361274 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ee5ef0a9-e1ea-4886-aa50-4e57ae7c3958 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:53.372342 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ee5ef0a9-e1ea-4886-aa50-4e57ae7c3958 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.169113 Jun 03 13:04:53.373132 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 152/297] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:53 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:53.745820 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a7d16e8e-1d69-44d8-a142-5601a7de4e2b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d094580-91c3-4ffc-91a7-f7daafc0fd9f"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:04:53.746941 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a7d16e8e-1d69-44d8-a142-5601a7de4e2b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:53.754239 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7d16e8e-1d69-44d8-a142-5601a7de4e2b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:53.754693 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7d16e8e-1d69-44d8-a142-5601a7de4e2b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:53.755473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7d16e8e-1d69-44d8-a142-5601a7de4e2b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:53.755945 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a7d16e8e-1d69-44d8-a142-5601a7de4e2b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:54.165769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a7d16e8e-1d69-44d8-a142-5601a7de4e2b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "POST /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426216 Jun 03 13:04:54.166995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 146/298] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:04:53 2022] POST /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:04:54.389772 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ae4b7a2c-c6df-4241-9636-196754fc370b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:54.390416 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ae4b7a2c-c6df-4241-9636-196754fc370b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:54.397156 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae4b7a2c-c6df-4241-9636-196754fc370b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:54.397613 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae4b7a2c-c6df-4241-9636-196754fc370b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:54.398429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae4b7a2c-c6df-4241-9636-196754fc370b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:54.398868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae4b7a2c-c6df-4241-9636-196754fc370b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:54.401373 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:04:54.538145 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ae4b7a2c-c6df-4241-9636-196754fc370b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:54.546668 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ae4b7a2c-c6df-4241-9636-196754fc370b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1502 microversion: 2.1 time: 0.160910 Jun 03 13:04:54.547259 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 153/299] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:54 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:54.565592 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fd11ec4b-91e7-49b6-b835-bddc681aeed4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9d9c4fb-223c-4dd1-96c4-cdac0287484e"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:04:54.566885 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fd11ec4b-91e7-49b6-b835-bddc681aeed4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:54.573180 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd11ec4b-91e7-49b6-b835-bddc681aeed4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:54.573658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd11ec4b-91e7-49b6-b835-bddc681aeed4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:54.574457 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd11ec4b-91e7-49b6-b835-bddc681aeed4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:54.574897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fd11ec4b-91e7-49b6-b835-bddc681aeed4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:54.598739 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-fd11ec4b-91e7-49b6-b835-bddc681aeed4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] HTTP exception thrown: Cannot 'attach_volume' instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 while it is in vm_state rescued Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fd11ec4b-91e7-49b6-b835-bddc681aeed4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Request method failure captured: Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: POST /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447/os-volume_attachments HTTP/1.1 Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 74 Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgZb6OIAoFXauJTIaqiZtgkaDduvm40Tmnjoq76MT68LNhb3WKogFBe-eGYSp6zeb8cQNqB8O0IkSk2-MR9STml5Hwl6q8-MoxwD30LLRKESM7goJVvYLGOEIN6xysNErIWQyMbX0Xw6HJDjU3-WmLkhh9NSHZX5VfSX6Mgt9tOPOxQ Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 45170704be9845929be13eb3a96eeb07 Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:04:54.600937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:04:54.602487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45170704be9845929be13eb3a96eeb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45170704be9845929be13eb3a96eeb07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45170704be9845929be13eb3a96eeb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45170704be9845929be13eb3a96eeb07"}]}] Jun 03 13:04:54.602487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:04:54.602487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 45170704be9845929be13eb3a96eeb07 Jun 03 13:04:54.602487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:04:54.602487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-ServerRescueNegativeTestJSON-972257074-project Jun 03 13:04:54.602487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:04:54.602487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:04:54.602487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 010c4d5ba6b847b79d3127787db2ddd6 Jun 03 13:04:54.602487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-972257074-project Jun 03 13:04:54.602487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Jun 03 13:04:54.602487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {"volumeAttachment": {"volumeId": "d9d9c4fb-223c-4dd1-96c4-cdac0287484e"}} Jun 03 13:04:54.602487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Cannot 'attach_volume' instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 while it is in vm_state rescued Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'server_id': '8810fcf9-5763-45c2-9e84-9a12f2fa1447', 'body': {'volumeAttachment': {'volumeId': 'd9d9c4fb-223c-4dd1-96c4-cdac0287484e'}}} Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:04:54.603350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 while it is in vm_state rescued Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:04:54.604628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:04:54.606014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:04:54.606014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:04:54.606014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 while it is in vm_state rescued Jun 03 13:04:54.606014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:04:54.606014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fd11ec4b-91e7-49b6-b835-bddc681aeed4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Returning 409 to user: Cannot 'attach_volume' instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 while it is in vm_state rescued {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:04:54.606014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fd11ec4b-91e7-49b6-b835-bddc681aeed4 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "POST /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041970 Jun 03 13:04:54.606014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 147/300] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:04:54 2022] POST /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 13:04:54.612313 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-41ae3756-42a5-4ad0-bb32-ff018f46706e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:04:54.612881 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-41ae3756-42a5-4ad0-bb32-ff018f46706e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:54.619262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41ae3756-42a5-4ad0-bb32-ff018f46706e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:54.619715 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41ae3756-42a5-4ad0-bb32-ff018f46706e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:54.620546 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41ae3756-42a5-4ad0-bb32-ff018f46706e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:54.621567 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41ae3756-42a5-4ad0-bb32-ff018f46706e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:54.693069 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-41ae3756-42a5-4ad0-bb32-ff018f46706e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "POST /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447/action" status: 202 len: 0 microversion: 2.1 time: 0.084925 Jun 03 13:04:54.697043 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 154/301] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:04:54 2022] POST /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:04:54.702589 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-50667ad0-9e2b-47e0-80fb-659174370604 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:54.703189 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-50667ad0-9e2b-47e0-80fb-659174370604 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:54.710576 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50667ad0-9e2b-47e0-80fb-659174370604 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:54.711492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50667ad0-9e2b-47e0-80fb-659174370604 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:54.712257 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50667ad0-9e2b-47e0-80fb-659174370604 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:54.712686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50667ad0-9e2b-47e0-80fb-659174370604 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:54.856577 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-50667ad0-9e2b-47e0-80fb-659174370604 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:54.865452 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-50667ad0-9e2b-47e0-80fb-659174370604 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1510 microversion: 2.1 time: 0.166918 Jun 03 13:04:54.866373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 148/302] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:54 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:55.884230 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5c09a739-24e2-413f-b493-08214031c418 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:55.884990 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5c09a739-24e2-413f-b493-08214031c418 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:55.892197 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c09a739-24e2-413f-b493-08214031c418 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:55.892685 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c09a739-24e2-413f-b493-08214031c418 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:55.893474 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c09a739-24e2-413f-b493-08214031c418 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:55.893948 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5c09a739-24e2-413f-b493-08214031c418 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:56.033081 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5c09a739-24e2-413f-b493-08214031c418 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:56.040577 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5c09a739-24e2-413f-b493-08214031c418 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1510 microversion: 2.1 time: 0.161314 Jun 03 13:04:56.041338 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 155/303] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:55 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:57.058315 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-18de1923-03ed-40d5-92f7-9529bd44ba4f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:57.058921 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-18de1923-03ed-40d5-92f7-9529bd44ba4f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:57.065460 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18de1923-03ed-40d5-92f7-9529bd44ba4f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:57.065903 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18de1923-03ed-40d5-92f7-9529bd44ba4f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:57.066685 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18de1923-03ed-40d5-92f7-9529bd44ba4f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:57.067113 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18de1923-03ed-40d5-92f7-9529bd44ba4f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:57.213272 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-18de1923-03ed-40d5-92f7-9529bd44ba4f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:57.216623 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-18de1923-03ed-40d5-92f7-9529bd44ba4f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1510 microversion: 2.1 time: 0.162122 Jun 03 13:04:57.226245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 149/304] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:57 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:58.234534 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-023ae19f-e54c-437f-9612-3f9d80aff85d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:58.235316 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-023ae19f-e54c-437f-9612-3f9d80aff85d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:58.242988 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-023ae19f-e54c-437f-9612-3f9d80aff85d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:58.243437 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-023ae19f-e54c-437f-9612-3f9d80aff85d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:58.244350 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-023ae19f-e54c-437f-9612-3f9d80aff85d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:58.244789 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-023ae19f-e54c-437f-9612-3f9d80aff85d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:58.403239 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-023ae19f-e54c-437f-9612-3f9d80aff85d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:58.419423 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-023ae19f-e54c-437f-9612-3f9d80aff85d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1510 microversion: 2.1 time: 0.186099 Jun 03 13:04:58.419423 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 156/305] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:58 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:04:59.435371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d0e69be5-44ed-4df7-9033-f03da666b8cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:04:59.436092 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d0e69be5-44ed-4df7-9033-f03da666b8cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:04:59.442495 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d0e69be5-44ed-4df7-9033-f03da666b8cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:59.443024 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d0e69be5-44ed-4df7-9033-f03da666b8cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:59.444111 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d0e69be5-44ed-4df7-9033-f03da666b8cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:04:59.444835 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d0e69be5-44ed-4df7-9033-f03da666b8cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:04:59.581439 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d0e69be5-44ed-4df7-9033-f03da666b8cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:04:59.590092 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d0e69be5-44ed-4df7-9033-f03da666b8cf tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1516 microversion: 2.1 time: 0.158922 Jun 03 13:04:59.590835 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 150/306] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:04:59 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:01.825042 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8198ef29-d27b-482f-887f-9cec57c8ad8e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:01.825662 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8198ef29-d27b-482f-887f-9cec57c8ad8e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:01.838897 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8198ef29-d27b-482f-887f-9cec57c8ad8e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:01.839347 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8198ef29-d27b-482f-887f-9cec57c8ad8e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:01.840144 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8198ef29-d27b-482f-887f-9cec57c8ad8e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:01.840582 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8198ef29-d27b-482f-887f-9cec57c8ad8e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:02.025480 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0e91c573-5fdc-4d50-8a84-d2b8d42e2222 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Action: 'create', calling method: .version_select at 0x7fc5a4ccd700>, body: {"keypair": {"name": "tempest-keypair-708785093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEn4ALTRn7U4WmjQ9x/Jy/y9rrD9aCF1SxvdK3PHIuw/KkURKLDUR48PLByScT8VPa/rKOzq8OmyvYi+YqZ6JsCSXZTOdKmOKc9H8bJ2Uad5oRWwiJWEtxEWGWyCcTEeeQ=="}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:05:02.035687 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:02.046495 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-0e91c573-5fdc-4d50-8a84-d2b8d42e2222 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Getting quotas for project 45170704be9845929be13eb3a96eeb07. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:05:02.059662 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8198ef29-d27b-482f-887f-9cec57c8ad8e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:02.072475 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-0e91c573-5fdc-4d50-8a84-d2b8d42e2222 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Getting quotas for user 010c4d5ba6b847b79d3127787db2ddd6 and project 45170704be9845929be13eb3a96eeb07. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:05:02.076465 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8198ef29-d27b-482f-887f-9cec57c8ad8e tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1594 microversion: 2.1 time: 0.255100 Jun 03 13:05:02.077038 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 157/307] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:01 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1594 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:02.116918 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0e91c573-5fdc-4d50-8a84-d2b8d42e2222 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.095769 Jun 03 13:05:02.117599 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 151/308] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Jun 3 13:05:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:05:03.909263 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1735080846", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1a5e9bbf-ee2a-49a3-8bbe-71deaba31087"}], "security_groups": [{"name": "tempest-securitygroup--1641323152"}], "key_name": "tempest-keypair-708785093", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:05:04.060058 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] validate_networks() for [('1a5e9bbf-ee2a-49a3-8bbe-71deaba31087', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:05:04.486253 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-07d8e7b6-14e0-4996-b6bf-2bccf13aaa3e req-858edc0f-aef0-4dc4-a6c3-9f756891cdff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0302f410-973f-4fde-b006-425696dadb3f", "tag": "5eb94fdb-2f92-4409-b6e6-5181bab08551"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:05:04.514430 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-07d8e7b6-14e0-4996-b6bf-2bccf13aaa3e req-858edc0f-aef0-4dc4-a6c3-9f756891cdff service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:04.515422 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-07d8e7b6-14e0-4996-b6bf-2bccf13aaa3e req-858edc0f-aef0-4dc4-a6c3-9f756891cdff service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:04.534514 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-07d8e7b6-14e0-4996-b6bf-2bccf13aaa3e req-858edc0f-aef0-4dc4-a6c3-9f756891cdff service nova] Creating event network-changed:5eb94fdb-2f92-4409-b6e6-5181bab08551 for instance 0302f410-973f-4fde-b006-425696dadb3f on hv-cinder-77954 Jun 03 13:05:04.552339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-07d8e7b6-14e0-4996-b6bf-2bccf13aaa3e req-858edc0f-aef0-4dc4-a6c3-9f756891cdff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070719 Jun 03 13:05:04.553518 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 152/309] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:05:04.612286 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:05:04.612991 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:05:04.613497 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:05:04.613892 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:05:04.614496 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:05:04.626362 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:04.627051 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:04.628106 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:04.628548 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:04.650957 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Getting quotas for project 45170704be9845929be13eb3a96eeb07. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:05:04.657824 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Getting quotas for user 010c4d5ba6b847b79d3127787db2ddd6 and project 45170704be9845929be13eb3a96eeb07. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:05:04.672065 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:05:04.674420 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:05:04.762631 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-da56c7ee-404f-4a94-ae78-4639b43ea079 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.859148 Jun 03 13:05:04.772117 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 158/310] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:05:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:05:04.784154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7de78654-4d22-4503-951a-474756fc636e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:04.785167 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7de78654-4d22-4503-951a-474756fc636e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:04.886727 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7de78654-4d22-4503-951a-474756fc636e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:04.896316 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7de78654-4d22-4503-951a-474756fc636e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1245 microversion: 2.1 time: 0.116648 Jun 03 13:05:04.897995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 153/311] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:04 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:05.914338 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e474737b-6fd8-4d31-b70e-ef40af9eca06 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:05.915539 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e474737b-6fd8-4d31-b70e-ef40af9eca06 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:05.928576 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e474737b-6fd8-4d31-b70e-ef40af9eca06 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:05.929025 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e474737b-6fd8-4d31-b70e-ef40af9eca06 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:05.932841 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e474737b-6fd8-4d31-b70e-ef40af9eca06 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:05.933285 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e474737b-6fd8-4d31-b70e-ef40af9eca06 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:05.938658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ede52234-7b2f-4efd-9ba7-3535d21d136f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2013920526"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:05:05.938658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ede52234-7b2f-4efd-9ba7-3535d21d136f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:05.947455 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ede52234-7b2f-4efd-9ba7-3535d21d136f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:05.947923 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ede52234-7b2f-4efd-9ba7-3535d21d136f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:05.948708 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ede52234-7b2f-4efd-9ba7-3535d21d136f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:05.949147 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ede52234-7b2f-4efd-9ba7-3535d21d136f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:06.000594 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e474737b-6fd8-4d31-b70e-ef40af9eca06 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:06.008057 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e474737b-6fd8-4d31-b70e-ef40af9eca06 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1249 microversion: 2.1 time: 0.097771 Jun 03 13:05:06.008664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 159/312] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:05 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:06.100024 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.network.security_group_api [None req-ede52234-7b2f-4efd-9ba7-3535d21d136f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Adding security group 96bd2c6f-d291-49bc-8b05-b2f0c07c171f to port 5eb94fdb-2f92-4409-b6e6-5181bab08551 Jun 03 13:05:06.553491 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ede52234-7b2f-4efd-9ba7-3535d21d136f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "POST /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/action" status: 202 len: 0 microversion: 2.1 time: 0.619896 Jun 03 13:05:06.558019 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 154/313] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:05:05 2022] POST /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 13:05:06.562870 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-8e1ce0d9-be2e-44e8-987d-a710526340ff req-9b73d009-fdf7-44a1-a147-4ee10beddd20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0302f410-973f-4fde-b006-425696dadb3f", "tag": "5eb94fdb-2f92-4409-b6e6-5181bab08551"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:05:06.563041 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f594c2dd-089f-48c9-adc3-7b244e54f7fd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:06.563681 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f594c2dd-089f-48c9-adc3-7b244e54f7fd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:06.570377 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f594c2dd-089f-48c9-adc3-7b244e54f7fd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:06.571025 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f594c2dd-089f-48c9-adc3-7b244e54f7fd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:06.571981 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f594c2dd-089f-48c9-adc3-7b244e54f7fd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:06.572578 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f594c2dd-089f-48c9-adc3-7b244e54f7fd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:06.573444 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8e1ce0d9-be2e-44e8-987d-a710526340ff req-9b73d009-fdf7-44a1-a147-4ee10beddd20 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:06.573886 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8e1ce0d9-be2e-44e8-987d-a710526340ff req-9b73d009-fdf7-44a1-a147-4ee10beddd20 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:06.599663 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-8e1ce0d9-be2e-44e8-987d-a710526340ff req-9b73d009-fdf7-44a1-a147-4ee10beddd20 service nova] Creating event network-changed:5eb94fdb-2f92-4409-b6e6-5181bab08551 for instance 0302f410-973f-4fde-b006-425696dadb3f on hv-cinder-77954 Jun 03 13:05:06.605318 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-8e1ce0d9-be2e-44e8-987d-a710526340ff req-9b73d009-fdf7-44a1-a147-4ee10beddd20 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047519 Jun 03 13:05:06.606529 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 160/314] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:05:06.740720 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f594c2dd-089f-48c9-adc3-7b244e54f7fd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:06.748790 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f594c2dd-089f-48c9-adc3-7b244e54f7fd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1641 microversion: 2.1 time: 0.190274 Jun 03 13:05:06.749585 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 155/315] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:06 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1641 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:07.025634 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9882d3fc-d897-4d10-b672-20d008d1f88a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:07.026220 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9882d3fc-d897-4d10-b672-20d008d1f88a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:07.033144 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9882d3fc-d897-4d10-b672-20d008d1f88a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:07.033589 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9882d3fc-d897-4d10-b672-20d008d1f88a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:07.034397 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9882d3fc-d897-4d10-b672-20d008d1f88a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:07.034828 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9882d3fc-d897-4d10-b672-20d008d1f88a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:07.105506 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9882d3fc-d897-4d10-b672-20d008d1f88a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:07.116330 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9882d3fc-d897-4d10-b672-20d008d1f88a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1249 microversion: 2.1 time: 0.094829 Jun 03 13:05:07.117100 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 161/316] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:07 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1249 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:08.135838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-03990099-270d-4152-84f9-01efbc47b64a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:08.136424 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-03990099-270d-4152-84f9-01efbc47b64a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:08.143472 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03990099-270d-4152-84f9-01efbc47b64a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:08.143916 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03990099-270d-4152-84f9-01efbc47b64a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:08.144695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03990099-270d-4152-84f9-01efbc47b64a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:08.145128 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03990099-270d-4152-84f9-01efbc47b64a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:08.215979 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-03990099-270d-4152-84f9-01efbc47b64a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:08.223901 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-03990099-270d-4152-84f9-01efbc47b64a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1249 microversion: 2.1 time: 0.091970 Jun 03 13:05:08.224463 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 156/317] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:08 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:09.244708 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ca1a93e7-8bb5-47a9-b494-921dbdee2c4e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:09.245750 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ca1a93e7-8bb5-47a9-b494-921dbdee2c4e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:09.253791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ca1a93e7-8bb5-47a9-b494-921dbdee2c4e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:09.254281 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ca1a93e7-8bb5-47a9-b494-921dbdee2c4e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:09.255059 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ca1a93e7-8bb5-47a9-b494-921dbdee2c4e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:09.255527 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ca1a93e7-8bb5-47a9-b494-921dbdee2c4e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:09.323349 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ca1a93e7-8bb5-47a9-b494-921dbdee2c4e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:09.331148 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ca1a93e7-8bb5-47a9-b494-921dbdee2c4e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1249 microversion: 2.1 time: 0.092989 Jun 03 13:05:09.331711 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 162/318] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:09 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:10.350224 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-256dae9c-ad60-4f4e-965c-6fcc7300206e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:10.351058 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-256dae9c-ad60-4f4e-965c-6fcc7300206e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:10.372321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-256dae9c-ad60-4f4e-965c-6fcc7300206e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:10.373193 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-256dae9c-ad60-4f4e-965c-6fcc7300206e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:10.377243 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-256dae9c-ad60-4f4e-965c-6fcc7300206e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:10.377800 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-256dae9c-ad60-4f4e-965c-6fcc7300206e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:10.468685 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-256dae9c-ad60-4f4e-965c-6fcc7300206e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:10.476953 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-256dae9c-ad60-4f4e-965c-6fcc7300206e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1241 microversion: 2.1 time: 0.132896 Jun 03 13:05:10.479317 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 157/319] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:10 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1241 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:11.496808 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a75155ba-f6b1-4420-a1cd-e0865655f974 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:11.497441 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a75155ba-f6b1-4420-a1cd-e0865655f974 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:11.503920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a75155ba-f6b1-4420-a1cd-e0865655f974 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:11.504379 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a75155ba-f6b1-4420-a1cd-e0865655f974 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:11.505391 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a75155ba-f6b1-4420-a1cd-e0865655f974 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:11.505852 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a75155ba-f6b1-4420-a1cd-e0865655f974 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:11.600238 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a75155ba-f6b1-4420-a1cd-e0865655f974 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:11.608377 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a75155ba-f6b1-4420-a1cd-e0865655f974 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1303 microversion: 2.1 time: 0.115731 Jun 03 13:05:11.609736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 163/320] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:11 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:05:12.582843 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-48cc6329-db68-40b8-a348-b67e321b4675 req-d1b6365d-6ab4-4912-b616-f170cfafb902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6908a57-1971-4cba-abd3-b6d365aebff0", "tag": "7485bbe7-40a4-4a93-bae4-e9f18264d13a"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:05:12.592178 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-48cc6329-db68-40b8-a348-b67e321b4675 req-d1b6365d-6ab4-4912-b616-f170cfafb902 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:12.593282 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-48cc6329-db68-40b8-a348-b67e321b4675 req-d1b6365d-6ab4-4912-b616-f170cfafb902 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:12.605227 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-48cc6329-db68-40b8-a348-b67e321b4675 req-d1b6365d-6ab4-4912-b616-f170cfafb902 service nova] Creating event network-changed:7485bbe7-40a4-4a93-bae4-e9f18264d13a for instance a6908a57-1971-4cba-abd3-b6d365aebff0 on hv-cinder-77954 Jun 03 13:05:12.611660 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-48cc6329-db68-40b8-a348-b67e321b4675 req-d1b6365d-6ab4-4912-b616-f170cfafb902 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036514 Jun 03 13:05:12.612388 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 158/321] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:05:12.630471 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-02af4b73-5855-42e2-8cf0-700ddd7c68b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:12.631259 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-02af4b73-5855-42e2-8cf0-700ddd7c68b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:12.640517 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-02af4b73-5855-42e2-8cf0-700ddd7c68b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:12.640976 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-02af4b73-5855-42e2-8cf0-700ddd7c68b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:12.642505 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-02af4b73-5855-42e2-8cf0-700ddd7c68b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:12.642963 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-02af4b73-5855-42e2-8cf0-700ddd7c68b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:12.917967 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-02af4b73-5855-42e2-8cf0-700ddd7c68b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:12.926766 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-02af4b73-5855-42e2-8cf0-700ddd7c68b2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.304284 Jun 03 13:05:12.927442 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 164/322] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:12 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:13.945811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-37267cd1-c8b6-473c-ac1f-6a315f627289 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:13.946532 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-37267cd1-c8b6-473c-ac1f-6a315f627289 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:13.953319 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37267cd1-c8b6-473c-ac1f-6a315f627289 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:13.953762 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37267cd1-c8b6-473c-ac1f-6a315f627289 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:13.954557 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37267cd1-c8b6-473c-ac1f-6a315f627289 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:13.954981 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-37267cd1-c8b6-473c-ac1f-6a315f627289 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:14.093375 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-37267cd1-c8b6-473c-ac1f-6a315f627289 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:14.095928 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:14.102549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-37267cd1-c8b6-473c-ac1f-6a315f627289 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.161503 Jun 03 13:05:14.103101 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 159/323] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:13 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:15.120873 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-776321db-756b-45b8-acf4-59b0434c930f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:15.121793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-776321db-756b-45b8-acf4-59b0434c930f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:15.123926 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:15.124585 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:15.131490 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-776321db-756b-45b8-acf4-59b0434c930f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:15.131946 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-776321db-756b-45b8-acf4-59b0434c930f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:15.132735 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-776321db-756b-45b8-acf4-59b0434c930f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:15.133184 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-776321db-756b-45b8-acf4-59b0434c930f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:15.273439 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-776321db-756b-45b8-acf4-59b0434c930f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:15.282042 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-776321db-756b-45b8-acf4-59b0434c930f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.165679 Jun 03 13:05:15.282859 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 165/324] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:15 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:16.300081 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8b256036-ecc0-4920-86fd-3558215fc45d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:16.300706 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8b256036-ecc0-4920-86fd-3558215fc45d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:16.302569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:16.309663 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8b256036-ecc0-4920-86fd-3558215fc45d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:16.310151 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8b256036-ecc0-4920-86fd-3558215fc45d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:16.310919 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8b256036-ecc0-4920-86fd-3558215fc45d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:16.311355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8b256036-ecc0-4920-86fd-3558215fc45d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:16.455909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8b256036-ecc0-4920-86fd-3558215fc45d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:16.463729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8b256036-ecc0-4920-86fd-3558215fc45d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.168393 Jun 03 13:05:16.464293 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 160/325] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:16 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:17.489371 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1689090a-5d43-4690-8daa-8f0553022026 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:17.489956 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1689090a-5d43-4690-8daa-8f0553022026 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:17.496564 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1689090a-5d43-4690-8daa-8f0553022026 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:17.497015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1689090a-5d43-4690-8daa-8f0553022026 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:17.497788 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1689090a-5d43-4690-8daa-8f0553022026 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:17.498264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1689090a-5d43-4690-8daa-8f0553022026 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:17.636828 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1689090a-5d43-4690-8daa-8f0553022026 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:17.649137 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1689090a-5d43-4690-8daa-8f0553022026 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.166455 Jun 03 13:05:17.649920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 166/326] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:17 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:18.669503 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6a0d4800-3924-49a1-8efd-f1ca99870ceb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:18.670147 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6a0d4800-3924-49a1-8efd-f1ca99870ceb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:18.673663 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:18.681141 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a0d4800-3924-49a1-8efd-f1ca99870ceb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:18.681762 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a0d4800-3924-49a1-8efd-f1ca99870ceb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:18.682979 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a0d4800-3924-49a1-8efd-f1ca99870ceb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:18.683546 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a0d4800-3924-49a1-8efd-f1ca99870ceb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:18.841700 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6a0d4800-3924-49a1-8efd-f1ca99870ceb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:18.849821 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6a0d4800-3924-49a1-8efd-f1ca99870ceb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.186499 Jun 03 13:05:18.850834 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 161/327] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:18 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:19.869629 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c8aa773c-13e3-467d-a4cd-59c53f3cbc2c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:19.870728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c8aa773c-13e3-467d-a4cd-59c53f3cbc2c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:19.873412 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:19.883112 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8aa773c-13e3-467d-a4cd-59c53f3cbc2c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:19.884373 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8aa773c-13e3-467d-a4cd-59c53f3cbc2c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:19.885295 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8aa773c-13e3-467d-a4cd-59c53f3cbc2c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:19.885840 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8aa773c-13e3-467d-a4cd-59c53f3cbc2c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:20.023290 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c8aa773c-13e3-467d-a4cd-59c53f3cbc2c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:20.032445 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c8aa773c-13e3-467d-a4cd-59c53f3cbc2c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.168197 Jun 03 13:05:20.033000 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 167/328] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:19 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:21.052015 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-883a8342-30b1-478b-a57a-65b6b74c13fc tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:21.052643 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-883a8342-30b1-478b-a57a-65b6b74c13fc tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:21.060499 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-883a8342-30b1-478b-a57a-65b6b74c13fc tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:21.060962 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-883a8342-30b1-478b-a57a-65b6b74c13fc tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:21.061808 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-883a8342-30b1-478b-a57a-65b6b74c13fc tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:21.062335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-883a8342-30b1-478b-a57a-65b6b74c13fc tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:21.202786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-883a8342-30b1-478b-a57a-65b6b74c13fc tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:21.210669 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-883a8342-30b1-478b-a57a-65b6b74c13fc tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.163540 Jun 03 13:05:21.211233 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 162/329] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:21 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:22.227659 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c767c6ca-ddc2-46d8-97af-4abe055e8d0a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:22.228277 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c767c6ca-ddc2-46d8-97af-4abe055e8d0a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:22.235386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c767c6ca-ddc2-46d8-97af-4abe055e8d0a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:22.235837 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c767c6ca-ddc2-46d8-97af-4abe055e8d0a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:22.236616 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c767c6ca-ddc2-46d8-97af-4abe055e8d0a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:22.237096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c767c6ca-ddc2-46d8-97af-4abe055e8d0a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:22.389458 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c767c6ca-ddc2-46d8-97af-4abe055e8d0a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:22.397981 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c767c6ca-ddc2-46d8-97af-4abe055e8d0a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.174252 Jun 03 13:05:22.398757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 168/330] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:22 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:23.415339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e1b164a7-c796-4670-9018-0368f525d644 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:23.416669 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e1b164a7-c796-4670-9018-0368f525d644 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:23.424013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1b164a7-c796-4670-9018-0368f525d644 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:23.424465 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1b164a7-c796-4670-9018-0368f525d644 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:23.425254 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1b164a7-c796-4670-9018-0368f525d644 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:23.425692 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1b164a7-c796-4670-9018-0368f525d644 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:23.565889 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e1b164a7-c796-4670-9018-0368f525d644 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:23.573510 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e1b164a7-c796-4670-9018-0368f525d644 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.163012 Jun 03 13:05:23.574209 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 163/331] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:23 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:24.590705 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9e4f3146-cfad-425c-805a-5e958887d461 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:24.591329 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9e4f3146-cfad-425c-805a-5e958887d461 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:24.597950 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e4f3146-cfad-425c-805a-5e958887d461 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:24.598427 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e4f3146-cfad-425c-805a-5e958887d461 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:24.599197 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e4f3146-cfad-425c-805a-5e958887d461 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:24.599632 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9e4f3146-cfad-425c-805a-5e958887d461 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:24.602527 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:24.737052 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9e4f3146-cfad-425c-805a-5e958887d461 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:24.748130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9e4f3146-cfad-425c-805a-5e958887d461 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.161131 Jun 03 13:05:24.748899 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 169/332] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:24 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:25.767978 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1ae2f26c-57ec-4ba2-b5a5-3b06b26a9cd3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:25.768610 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1ae2f26c-57ec-4ba2-b5a5-3b06b26a9cd3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:25.775593 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ae2f26c-57ec-4ba2-b5a5-3b06b26a9cd3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:25.776047 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ae2f26c-57ec-4ba2-b5a5-3b06b26a9cd3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:25.776818 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ae2f26c-57ec-4ba2-b5a5-3b06b26a9cd3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:25.777250 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1ae2f26c-57ec-4ba2-b5a5-3b06b26a9cd3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:25.922684 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1ae2f26c-57ec-4ba2-b5a5-3b06b26a9cd3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:25.930263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1ae2f26c-57ec-4ba2-b5a5-3b06b26a9cd3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.167648 Jun 03 13:05:25.930837 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 164/333] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:25 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:26.949984 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-75652496-feff-4fc4-ad23-c9cefdd79f11 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:26.950611 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-75652496-feff-4fc4-ad23-c9cefdd79f11 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:26.958055 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75652496-feff-4fc4-ad23-c9cefdd79f11 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:26.959288 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75652496-feff-4fc4-ad23-c9cefdd79f11 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:26.960288 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75652496-feff-4fc4-ad23-c9cefdd79f11 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:26.960770 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75652496-feff-4fc4-ad23-c9cefdd79f11 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:27.095171 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-75652496-feff-4fc4-ad23-c9cefdd79f11 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:27.102730 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-75652496-feff-4fc4-ad23-c9cefdd79f11 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.156721 Jun 03 13:05:27.103302 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 170/334] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:26 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:28.120212 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-052219d4-5175-49af-baad-9f0f91e1c594 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:28.120822 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-052219d4-5175-49af-baad-9f0f91e1c594 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:28.127442 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-052219d4-5175-49af-baad-9f0f91e1c594 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:28.127881 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-052219d4-5175-49af-baad-9f0f91e1c594 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:28.128635 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-052219d4-5175-49af-baad-9f0f91e1c594 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:28.129069 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-052219d4-5175-49af-baad-9f0f91e1c594 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:28.263173 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-052219d4-5175-49af-baad-9f0f91e1c594 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:28.273419 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-052219d4-5175-49af-baad-9f0f91e1c594 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.156728 Jun 03 13:05:28.274410 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 165/335] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:28 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:29.295211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6abd515b-0330-4049-8d83-f1fdc818e67d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:29.296202 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6abd515b-0330-4049-8d83-f1fdc818e67d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:29.303430 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6abd515b-0330-4049-8d83-f1fdc818e67d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:29.303876 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6abd515b-0330-4049-8d83-f1fdc818e67d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:29.304640 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6abd515b-0330-4049-8d83-f1fdc818e67d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:29.305072 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6abd515b-0330-4049-8d83-f1fdc818e67d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:29.435580 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6abd515b-0330-4049-8d83-f1fdc818e67d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:29.447803 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6abd515b-0330-4049-8d83-f1fdc818e67d tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.158807 Jun 03 13:05:29.448664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 171/336] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:29 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:30.431993 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-a2eb5b25-c2b7-4bd7-a94a-dc2929fc9e11 req-435c6c3f-f006-44d5-b0d2-a9a11d915b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6908a57-1971-4cba-abd3-b6d365aebff0", "name": "network-vif-plugged", "status": "completed", "tag": "7485bbe7-40a4-4a93-bae4-e9f18264d13a"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:05:30.444308 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-a2eb5b25-c2b7-4bd7-a94a-dc2929fc9e11 req-435c6c3f-f006-44d5-b0d2-a9a11d915b81 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:30.444966 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-a2eb5b25-c2b7-4bd7-a94a-dc2929fc9e11 req-435c6c3f-f006-44d5-b0d2-a9a11d915b81 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:30.456314 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-a2eb5b25-c2b7-4bd7-a94a-dc2929fc9e11 req-435c6c3f-f006-44d5-b0d2-a9a11d915b81 service nova] Creating event network-vif-plugged:7485bbe7-40a4-4a93-bae4-e9f18264d13a for instance a6908a57-1971-4cba-abd3-b6d365aebff0 on hv-cinder-77954 Jun 03 13:05:30.461459 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-a2eb5b25-c2b7-4bd7-a94a-dc2929fc9e11 req-435c6c3f-f006-44d5-b0d2-a9a11d915b81 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034234 Jun 03 13:05:30.462304 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 166/337] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:05:30.466323 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ff3d4bf2-9052-4221-b26e-021866d5cf81 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:30.466937 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ff3d4bf2-9052-4221-b26e-021866d5cf81 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:30.478571 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff3d4bf2-9052-4221-b26e-021866d5cf81 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:30.479035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff3d4bf2-9052-4221-b26e-021866d5cf81 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:30.479795 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff3d4bf2-9052-4221-b26e-021866d5cf81 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:30.480223 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ff3d4bf2-9052-4221-b26e-021866d5cf81 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:30.629924 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ff3d4bf2-9052-4221-b26e-021866d5cf81 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:30.638036 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ff3d4bf2-9052-4221-b26e-021866d5cf81 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.175721 Jun 03 13:05:30.638664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 172/338] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:30 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:05:31.657644 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3fc8dfd3-c66d-47b7-86ff-e42613487342 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:31.658409 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3fc8dfd3-c66d-47b7-86ff-e42613487342 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:31.665322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3fc8dfd3-c66d-47b7-86ff-e42613487342 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:31.665772 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3fc8dfd3-c66d-47b7-86ff-e42613487342 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:31.666589 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3fc8dfd3-c66d-47b7-86ff-e42613487342 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:31.667033 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3fc8dfd3-c66d-47b7-86ff-e42613487342 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:31.803520 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3fc8dfd3-c66d-47b7-86ff-e42613487342 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:31.811313 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3fc8dfd3-c66d-47b7-86ff-e42613487342 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.158422 Jun 03 13:05:31.811880 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 167/339] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:31 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:32.829097 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3e253e1b-2a0b-419e-9ed3-e3f002ae7e8b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:32.829653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3e253e1b-2a0b-419e-9ed3-e3f002ae7e8b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:32.835799 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3e253e1b-2a0b-419e-9ed3-e3f002ae7e8b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:32.836243 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3e253e1b-2a0b-419e-9ed3-e3f002ae7e8b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:32.837036 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3e253e1b-2a0b-419e-9ed3-e3f002ae7e8b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:32.837465 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3e253e1b-2a0b-419e-9ed3-e3f002ae7e8b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:32.981684 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3e253e1b-2a0b-419e-9ed3-e3f002ae7e8b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:32.990409 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3e253e1b-2a0b-419e-9ed3-e3f002ae7e8b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1371 microversion: 2.1 time: 0.165410 Jun 03 13:05:32.991008 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 173/340] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:32 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:34.007661 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-32efd636-56ab-44a4-afc2-2bf1bbf46e99 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:34.008382 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-32efd636-56ab-44a4-afc2-2bf1bbf46e99 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:34.015405 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-32efd636-56ab-44a4-afc2-2bf1bbf46e99 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:34.016099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-32efd636-56ab-44a4-afc2-2bf1bbf46e99 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:34.016751 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-32efd636-56ab-44a4-afc2-2bf1bbf46e99 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:34.017186 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-32efd636-56ab-44a4-afc2-2bf1bbf46e99 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:34.149964 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-32efd636-56ab-44a4-afc2-2bf1bbf46e99 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:34.157708 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-32efd636-56ab-44a4-afc2-2bf1bbf46e99 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1564 microversion: 2.1 time: 0.154043 Jun 03 13:05:34.158351 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 168/341] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:34 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:34.174089 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b43349e6-27e9-4731-b291-a84a66db08ac tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:34.174615 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b43349e6-27e9-4731-b291-a84a66db08ac tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:34.181411 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b43349e6-27e9-4731-b291-a84a66db08ac tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:34.181864 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b43349e6-27e9-4731-b291-a84a66db08ac tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:34.182692 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b43349e6-27e9-4731-b291-a84a66db08ac tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:34.183131 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b43349e6-27e9-4731-b291-a84a66db08ac tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:34.263849 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b43349e6-27e9-4731-b291-a84a66db08ac tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093280 Jun 03 13:05:34.264727 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 174/342] 10.222.0.58 () {58 vars in 1274 bytes} [Fri Jun 3 13:05:34 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:05:35.605740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-9332f273-1c7e-4224-8175-95205fdca0a9 req-8a82bba5-698e-40fb-8cba-fa5a33fa7006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6908a57-1971-4cba-abd3-b6d365aebff0", "tag": "7485bbe7-40a4-4a93-bae4-e9f18264d13a"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:05:35.614851 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-9332f273-1c7e-4224-8175-95205fdca0a9 req-8a82bba5-698e-40fb-8cba-fa5a33fa7006 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:35.615310 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-9332f273-1c7e-4224-8175-95205fdca0a9 req-8a82bba5-698e-40fb-8cba-fa5a33fa7006 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:35.626624 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-9332f273-1c7e-4224-8175-95205fdca0a9 req-8a82bba5-698e-40fb-8cba-fa5a33fa7006 service nova] Creating event network-changed:7485bbe7-40a4-4a93-bae4-e9f18264d13a for instance a6908a57-1971-4cba-abd3-b6d365aebff0 on hv-cinder-77954 Jun 03 13:05:35.631614 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-9332f273-1c7e-4224-8175-95205fdca0a9 req-8a82bba5-698e-40fb-8cba-fa5a33fa7006 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029587 Jun 03 13:05:35.632527 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 169/343] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:05:48.235863 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=15 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:48.236621 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=33 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:48.242155 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1722141926", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "networks": [{"uuid": "6fd9d9aa-f28d-4116-ab9d-c85867765f0e"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:05:48.300559 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] validate_networks() for [('6fd9d9aa-f28d-4116-ab9d-c85867765f0e', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:05:48.655820 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:05:48.656251 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:05:48.656727 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:05:48.657171 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:05:48.657607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:05:48.666865 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:48.667232 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:48.668060 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:48.668503 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:48.686010 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Getting quotas for project b579f36c6162451daa31ad27aa97a083. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:05:48.690583 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Getting quotas for user 50ff2e53a17c4052a08ebe104034ab80 and project b579f36c6162451daa31ad27aa97a083. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:05:48.703039 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:05:48.705287 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:05:48.770408 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8cd0c645-16ba-4a72-ba0d-89b9975650c1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535306 Jun 03 13:05:48.771040 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 175/344] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:05:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:05:48.779267 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=17 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:48.780102 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=53 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:48.784321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0cdc2022-565f-40a0-aaa9-bbaa63d24065 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:48.785022 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0cdc2022-565f-40a0-aaa9-bbaa63d24065 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:48.843062 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0cdc2022-565f-40a0-aaa9-bbaa63d24065 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:48.850034 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0cdc2022-565f-40a0-aaa9-bbaa63d24065 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1219 microversion: 2.1 time: 0.072530 Jun 03 13:05:48.850637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 170/345] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:48 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:49.867562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5e9807c1-c36f-4ae3-83a7-71b3dbe2d1e1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:49.868884 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5e9807c1-c36f-4ae3-83a7-71b3dbe2d1e1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:49.875257 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e9807c1-c36f-4ae3-83a7-71b3dbe2d1e1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:49.876118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e9807c1-c36f-4ae3-83a7-71b3dbe2d1e1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:49.876905 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e9807c1-c36f-4ae3-83a7-71b3dbe2d1e1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:49.877385 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5e9807c1-c36f-4ae3-83a7-71b3dbe2d1e1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:49.951205 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5e9807c1-c36f-4ae3-83a7-71b3dbe2d1e1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:49.959439 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5e9807c1-c36f-4ae3-83a7-71b3dbe2d1e1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1289 microversion: 2.1 time: 0.096227 Jun 03 13:05:49.960240 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 176/346] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:49 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:50.977151 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f8e48ce6-ebcb-4d9a-8c56-661b938ca57b tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:50.977725 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f8e48ce6-ebcb-4d9a-8c56-661b938ca57b tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:50.985703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8e48ce6-ebcb-4d9a-8c56-661b938ca57b tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:50.986182 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8e48ce6-ebcb-4d9a-8c56-661b938ca57b tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:50.987097 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8e48ce6-ebcb-4d9a-8c56-661b938ca57b tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:50.987933 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f8e48ce6-ebcb-4d9a-8c56-661b938ca57b tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:51.209373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f8e48ce6-ebcb-4d9a-8c56-661b938ca57b tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:51.217065 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f8e48ce6-ebcb-4d9a-8c56-661b938ca57b tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1319 microversion: 2.1 time: 0.244095 Jun 03 13:05:51.217641 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 171/347] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:50 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:51.516453 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-cac6f47e-3fe2-4ddd-827b-7e965dc40d37 req-cfcfefd2-3ea5-4cac-9696-1461007257b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e08e917b-319c-4a53-b3b2-ccfc64195c64", "tag": "1bee1e74-e70b-441b-82e0-9cd1ef130dc1"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:05:51.526254 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-cac6f47e-3fe2-4ddd-827b-7e965dc40d37 req-cfcfefd2-3ea5-4cac-9696-1461007257b7 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:51.526821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-cac6f47e-3fe2-4ddd-827b-7e965dc40d37 req-cfcfefd2-3ea5-4cac-9696-1461007257b7 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:51.541111 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-cac6f47e-3fe2-4ddd-827b-7e965dc40d37 req-cfcfefd2-3ea5-4cac-9696-1461007257b7 service nova] Creating event network-changed:1bee1e74-e70b-441b-82e0-9cd1ef130dc1 for instance e08e917b-319c-4a53-b3b2-ccfc64195c64 on hv-cinder-77954 Jun 03 13:05:51.546508 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-cac6f47e-3fe2-4ddd-827b-7e965dc40d37 req-cfcfefd2-3ea5-4cac-9696-1461007257b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035112 Jun 03 13:05:51.547114 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 177/348] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:05:52.237423 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-184d756e-c353-4993-bd14-d475cf2dc6a6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:52.238468 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-184d756e-c353-4993-bd14-d475cf2dc6a6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:52.248139 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-184d756e-c353-4993-bd14-d475cf2dc6a6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:52.248781 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-184d756e-c353-4993-bd14-d475cf2dc6a6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:52.249889 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-184d756e-c353-4993-bd14-d475cf2dc6a6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:52.250573 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-184d756e-c353-4993-bd14-d475cf2dc6a6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:52.392319 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-184d756e-c353-4993-bd14-d475cf2dc6a6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:52.400050 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-184d756e-c353-4993-bd14-d475cf2dc6a6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1319 microversion: 2.1 time: 0.168652 Jun 03 13:05:52.400628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 172/349] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:52 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:53.418993 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b22d629b-e889-49ad-bbb5-a2a50a1cdc73 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:53.419651 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b22d629b-e889-49ad-bbb5-a2a50a1cdc73 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:53.426720 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b22d629b-e889-49ad-bbb5-a2a50a1cdc73 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:53.427169 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b22d629b-e889-49ad-bbb5-a2a50a1cdc73 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:53.427949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b22d629b-e889-49ad-bbb5-a2a50a1cdc73 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:53.428383 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b22d629b-e889-49ad-bbb5-a2a50a1cdc73 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:53.564812 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b22d629b-e889-49ad-bbb5-a2a50a1cdc73 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:53.572978 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b22d629b-e889-49ad-bbb5-a2a50a1cdc73 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1319 microversion: 2.1 time: 0.159694 Jun 03 13:05:53.573548 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 178/350] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:53 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:54.589905 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cdc0cfef-dcff-4fe0-b97e-e3bd39df79f5 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:54.590413 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cdc0cfef-dcff-4fe0-b97e-e3bd39df79f5 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:54.597510 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cdc0cfef-dcff-4fe0-b97e-e3bd39df79f5 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:54.598034 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cdc0cfef-dcff-4fe0-b97e-e3bd39df79f5 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:54.598836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cdc0cfef-dcff-4fe0-b97e-e3bd39df79f5 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:54.599269 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cdc0cfef-dcff-4fe0-b97e-e3bd39df79f5 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:54.768811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cdc0cfef-dcff-4fe0-b97e-e3bd39df79f5 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:54.776981 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cdc0cfef-dcff-4fe0-b97e-e3bd39df79f5 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1319 microversion: 2.1 time: 0.191135 Jun 03 13:05:54.777588 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 173/351] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:54 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:55.794315 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a40a38d5-e7a4-4ee1-9cda-27d9df0d9cef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:55.794879 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a40a38d5-e7a4-4ee1-9cda-27d9df0d9cef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:55.801744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a40a38d5-e7a4-4ee1-9cda-27d9df0d9cef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:55.802519 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a40a38d5-e7a4-4ee1-9cda-27d9df0d9cef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:55.803305 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a40a38d5-e7a4-4ee1-9cda-27d9df0d9cef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:55.803733 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a40a38d5-e7a4-4ee1-9cda-27d9df0d9cef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:55.952889 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a40a38d5-e7a4-4ee1-9cda-27d9df0d9cef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:55.964508 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a40a38d5-e7a4-4ee1-9cda-27d9df0d9cef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1319 microversion: 2.1 time: 0.173871 Jun 03 13:05:55.965253 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 179/352] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:55 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:56.985310 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8e1e172e-e6c8-42e3-a9c1-51c9995b1d05 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:56.985879 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8e1e172e-e6c8-42e3-a9c1-51c9995b1d05 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:56.993398 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e1e172e-e6c8-42e3-a9c1-51c9995b1d05 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:56.993845 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e1e172e-e6c8-42e3-a9c1-51c9995b1d05 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:56.994628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e1e172e-e6c8-42e3-a9c1-51c9995b1d05 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:56.995051 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e1e172e-e6c8-42e3-a9c1-51c9995b1d05 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:57.128925 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8e1e172e-e6c8-42e3-a9c1-51c9995b1d05 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:57.137019 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8e1e172e-e6c8-42e3-a9c1-51c9995b1d05 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1319 microversion: 2.1 time: 0.155958 Jun 03 13:05:57.137585 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 174/353] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:56 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:58.158304 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-71614ad9-0039-49d2-a7c0-db75037d4d59 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:58.159300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-71614ad9-0039-49d2-a7c0-db75037d4d59 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:58.166556 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71614ad9-0039-49d2-a7c0-db75037d4d59 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:58.167007 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71614ad9-0039-49d2-a7c0-db75037d4d59 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:58.167783 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71614ad9-0039-49d2-a7c0-db75037d4d59 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:58.168217 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-71614ad9-0039-49d2-a7c0-db75037d4d59 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:58.303979 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-71614ad9-0039-49d2-a7c0-db75037d4d59 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:58.315659 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-71614ad9-0039-49d2-a7c0-db75037d4d59 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1319 microversion: 2.1 time: 0.163492 Jun 03 13:05:58.316427 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 180/354] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:58 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:05:58.525157 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-e0e378a6-0b6e-461c-a1ea-77bbed133bd6 req-d63a35ee-011b-49b1-bbb0-4cabbd021881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08e917b-319c-4a53-b3b2-ccfc64195c64", "name": "network-vif-plugged", "status": "completed", "tag": "1bee1e74-e70b-441b-82e0-9cd1ef130dc1"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:05:58.534042 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-e0e378a6-0b6e-461c-a1ea-77bbed133bd6 req-d63a35ee-011b-49b1-bbb0-4cabbd021881 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:58.534592 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-e0e378a6-0b6e-461c-a1ea-77bbed133bd6 req-d63a35ee-011b-49b1-bbb0-4cabbd021881 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:58.549876 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-e0e378a6-0b6e-461c-a1ea-77bbed133bd6 req-d63a35ee-011b-49b1-bbb0-4cabbd021881 service nova] Creating event network-vif-plugged:1bee1e74-e70b-441b-82e0-9cd1ef130dc1 for instance e08e917b-319c-4a53-b3b2-ccfc64195c64 on hv-cinder-77954 Jun 03 13:05:58.555798 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-e0e378a6-0b6e-461c-a1ea-77bbed133bd6 req-d63a35ee-011b-49b1-bbb0-4cabbd021881 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034456 Jun 03 13:05:58.556591 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 175/355] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:05:59.335241 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-aa32042f-a34d-4347-bb4d-000cb6f1ed1d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:05:59.335817 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-aa32042f-a34d-4347-bb4d-000cb6f1ed1d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:05:59.337817 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:59.338551 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:05:59.344832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aa32042f-a34d-4347-bb4d-000cb6f1ed1d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:59.345277 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aa32042f-a34d-4347-bb4d-000cb6f1ed1d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:59.346044 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aa32042f-a34d-4347-bb4d-000cb6f1ed1d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:05:59.346501 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aa32042f-a34d-4347-bb4d-000cb6f1ed1d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:05:59.483412 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-aa32042f-a34d-4347-bb4d-000cb6f1ed1d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:05:59.493041 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-aa32042f-a34d-4347-bb4d-000cb6f1ed1d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1319 microversion: 2.1 time: 0.162979 Jun 03 13:05:59.493585 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 181/356] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:05:59 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:00.508485 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:00.513425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-95d3b001-6b90-44d6-8e9a-e3a1ec03aa64 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:00.513988 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-95d3b001-6b90-44d6-8e9a-e3a1ec03aa64 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:00.522696 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95d3b001-6b90-44d6-8e9a-e3a1ec03aa64 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:00.523119 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95d3b001-6b90-44d6-8e9a-e3a1ec03aa64 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:00.523928 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95d3b001-6b90-44d6-8e9a-e3a1ec03aa64 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:00.524360 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95d3b001-6b90-44d6-8e9a-e3a1ec03aa64 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:00.686005 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-95d3b001-6b90-44d6-8e9a-e3a1ec03aa64 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:00.697592 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-95d3b001-6b90-44d6-8e9a-e3a1ec03aa64 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1509 microversion: 2.1 time: 0.189881 Jun 03 13:06:00.698180 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 176/357] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:00 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:14.096366 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0007c05d-7de5-4e86-892b-d04b6845cd51 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:14.097291 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0007c05d-7de5-4e86-892b-d04b6845cd51 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:14.100133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:14.101349 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=34 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:14.112257 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0007c05d-7de5-4e86-892b-d04b6845cd51 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:14.112907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0007c05d-7de5-4e86-892b-d04b6845cd51 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:14.114200 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0007c05d-7de5-4e86-892b-d04b6845cd51 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:14.114944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0007c05d-7de5-4e86-892b-d04b6845cd51 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:14.140965 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0007c05d-7de5-4e86-892b-d04b6845cd51 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/ips" status: 200 len: 149 microversion: 2.1 time: 0.051193 Jun 03 13:06:14.141522 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 182/358] 10.222.0.58 () {58 vars in 1247 bytes} [Fri Jun 3 13:06:14 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:06:15.516209 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ae0f7bee-f5da-4e5f-bc4d-2ca802452dd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4c9fda0-7b2d-48f2-90bf-9ef12ddea229"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:06:15.517269 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ae0f7bee-f5da-4e5f-bc4d-2ca802452dd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:15.519734 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=16 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:15.520415 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=32 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:15.526626 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae0f7bee-f5da-4e5f-bc4d-2ca802452dd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:15.527066 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae0f7bee-f5da-4e5f-bc4d-2ca802452dd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:15.527818 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae0f7bee-f5da-4e5f-bc4d-2ca802452dd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:15.528247 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae0f7bee-f5da-4e5f-bc4d-2ca802452dd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:15.802803 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ae0f7bee-f5da-4e5f-bc4d-2ca802452dd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290408 Jun 03 13:06:15.803406 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 177/359] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:06:15 2022] POST /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:06:23.360157 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-82de7e46-5f5a-4b60-890c-609025b74d83 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: .version_select at 0x7fc5a45578b0>, body: {"keypair": {"name": "tempest-keypair-1910236072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKwlmC1SCWTynUcZebL4vCg628Ou6W3tFKX4HBEWHQrZ8iEKUBcNbvHi1hUigPqvT5lrEPpwGn9OfRF0UnoFtkDjjmc3vyubWIWigV21vbqHGeM+W3JcMB6WpF5sm1i7g=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:06:23.382960 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-82de7e46-5f5a-4b60-890c-609025b74d83 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:06:23.382960 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-82de7e46-5f5a-4b60-890c-609025b74d83 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for user f2217b3c134d453fbdcb14853eed4e3b and project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:06:23.407344 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-82de7e46-5f5a-4b60-890c-609025b74d83 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052002 Jun 03 13:06:23.407940 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 183/360] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Jun 3 13:06:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:06:24.442323 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7514ed2b-fb7f-4c10-814e-b397632f65ef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "179884c9-f9d9-405a-9009-c40d4d1ccabf", "device": "/dev/sdb"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:06:24.443999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7514ed2b-fb7f-4c10-814e-b397632f65ef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:24.450891 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7514ed2b-fb7f-4c10-814e-b397632f65ef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:24.451339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7514ed2b-fb7f-4c10-814e-b397632f65ef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:24.452097 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7514ed2b-fb7f-4c10-814e-b397632f65ef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:24.452734 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7514ed2b-fb7f-4c10-814e-b397632f65ef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:24.709910 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7514ed2b-fb7f-4c10-814e-b397632f65ef tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "POST /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271748 Jun 03 13:06:24.710555 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 178/361] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:06:24 2022] POST /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:06:24.757365 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:24.763190 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-491268431", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d6f325b-d3a4-43a7-8d89-d0ffbb50df9b"}], "security_groups": [{"name": "tempest-securitygroup--1112760633"}], "key_name": "tempest-keypair-1910236072", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:06:24.871032 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] validate_networks() for [('6d6f325b-d3a4-43a7-8d89-d0ffbb50df9b', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:06:25.248636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:06:25.249062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:06:25.249537 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:06:25.249951 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:06:25.250406 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:06:25.259768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:25.260250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:25.261055 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:25.261486 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:25.278177 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:06:25.282261 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for user f2217b3c134d453fbdcb14853eed4e3b and project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:06:25.294040 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:06:25.296368 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:06:25.343651 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-958e97da-e03b-42a6-9472-11da54c4982f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.586908 Jun 03 13:06:25.344286 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 184/362] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:06:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:06:25.355018 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d6af8bae-cf27-4fab-8eab-7d9aaf63e01d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:25.355717 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d6af8bae-cf27-4fab-8eab-7d9aaf63e01d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:25.412748 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d6af8bae-cf27-4fab-8eab-7d9aaf63e01d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:25.419828 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d6af8bae-cf27-4fab-8eab-7d9aaf63e01d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1241 microversion: 2.1 time: 0.069287 Jun 03 13:06:25.420406 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 179/363] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:25 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:26.437840 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-29def799-906f-4b66-8b4d-ed5dd68a1d70 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:26.438634 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-29def799-906f-4b66-8b4d-ed5dd68a1d70 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:26.451372 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29def799-906f-4b66-8b4d-ed5dd68a1d70 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:26.452035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29def799-906f-4b66-8b4d-ed5dd68a1d70 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:26.453565 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29def799-906f-4b66-8b4d-ed5dd68a1d70 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:26.454261 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-29def799-906f-4b66-8b4d-ed5dd68a1d70 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:26.548972 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-29def799-906f-4b66-8b4d-ed5dd68a1d70 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:26.557028 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-29def799-906f-4b66-8b4d-ed5dd68a1d70 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1311 microversion: 2.1 time: 0.123263 Jun 03 13:06:26.557945 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 185/364] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:26 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1311 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:27.578711 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a2f08a35-12d3-470c-a7c5-188fe9679401 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:27.579931 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a2f08a35-12d3-470c-a7c5-188fe9679401 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:27.593353 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2f08a35-12d3-470c-a7c5-188fe9679401 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:27.594195 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2f08a35-12d3-470c-a7c5-188fe9679401 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:27.595840 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2f08a35-12d3-470c-a7c5-188fe9679401 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:27.596660 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2f08a35-12d3-470c-a7c5-188fe9679401 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:27.810681 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a2f08a35-12d3-470c-a7c5-188fe9679401 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:27.819129 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a2f08a35-12d3-470c-a7c5-188fe9679401 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.248061 Jun 03 13:06:27.819702 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 180/365] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:27 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:27.880160 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-624388ed-d75f-4e28-a8a9-b2a7f1b00a26 req-317cc65a-0a85-40b3-8af9-59a93f384dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fb1319-f284-49dc-a3eb-2574997aec2f", "tag": "7d7e272d-3c3e-4fa0-8fe6-be6388ec93cb"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:06:27.891379 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-624388ed-d75f-4e28-a8a9-b2a7f1b00a26 req-317cc65a-0a85-40b3-8af9-59a93f384dac service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:27.892011 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-624388ed-d75f-4e28-a8a9-b2a7f1b00a26 req-317cc65a-0a85-40b3-8af9-59a93f384dac service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:27.905391 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-624388ed-d75f-4e28-a8a9-b2a7f1b00a26 req-317cc65a-0a85-40b3-8af9-59a93f384dac service nova] Creating event network-changed:7d7e272d-3c3e-4fa0-8fe6-be6388ec93cb for instance 27fb1319-f284-49dc-a3eb-2574997aec2f on hv-cinder-77954 Jun 03 13:06:27.910646 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-624388ed-d75f-4e28-a8a9-b2a7f1b00a26 req-317cc65a-0a85-40b3-8af9-59a93f384dac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034181 Jun 03 13:06:27.911376 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 186/366] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:06:28.840376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6d8c2130-15c8-4172-8e43-6f4ab51d8da1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:28.841000 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6d8c2130-15c8-4172-8e43-6f4ab51d8da1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:28.848614 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d8c2130-15c8-4172-8e43-6f4ab51d8da1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:28.849067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d8c2130-15c8-4172-8e43-6f4ab51d8da1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:28.849851 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d8c2130-15c8-4172-8e43-6f4ab51d8da1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:28.850339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6d8c2130-15c8-4172-8e43-6f4ab51d8da1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:28.990985 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6d8c2130-15c8-4172-8e43-6f4ab51d8da1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:28.999030 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6d8c2130-15c8-4172-8e43-6f4ab51d8da1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.164767 Jun 03 13:06:29.007723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 181/367] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:28 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:30.021984 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c261e115-ebac-4eec-af8c-f96811a51fa4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:30.023203 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c261e115-ebac-4eec-af8c-f96811a51fa4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:30.034932 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c261e115-ebac-4eec-af8c-f96811a51fa4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:30.035420 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c261e115-ebac-4eec-af8c-f96811a51fa4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:30.036702 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c261e115-ebac-4eec-af8c-f96811a51fa4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:30.037433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c261e115-ebac-4eec-af8c-f96811a51fa4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:30.408924 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c261e115-ebac-4eec-af8c-f96811a51fa4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:30.418519 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c261e115-ebac-4eec-af8c-f96811a51fa4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.403580 Jun 03 13:06:30.419063 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 187/368] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:30 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:31.439453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-930d44de-5ce9-4258-a045-64758e6268e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:31.440299 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-930d44de-5ce9-4258-a045-64758e6268e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:31.450887 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-930d44de-5ce9-4258-a045-64758e6268e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:31.451314 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-930d44de-5ce9-4258-a045-64758e6268e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:31.452086 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-930d44de-5ce9-4258-a045-64758e6268e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:31.452523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-930d44de-5ce9-4258-a045-64758e6268e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:31.592901 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-930d44de-5ce9-4258-a045-64758e6268e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:31.601860 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-930d44de-5ce9-4258-a045-64758e6268e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.169044 Jun 03 13:06:31.602512 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 182/369] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:31 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:32.619660 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8fa07f8d-0b06-49d9-b910-120372590d7b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:32.620267 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8fa07f8d-0b06-49d9-b910-120372590d7b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:32.627083 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8fa07f8d-0b06-49d9-b910-120372590d7b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:32.627551 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8fa07f8d-0b06-49d9-b910-120372590d7b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:32.628332 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8fa07f8d-0b06-49d9-b910-120372590d7b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:32.628772 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8fa07f8d-0b06-49d9-b910-120372590d7b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:32.823249 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8fa07f8d-0b06-49d9-b910-120372590d7b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:32.830996 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8fa07f8d-0b06-49d9-b910-120372590d7b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.215260 Jun 03 13:06:32.831570 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 188/370] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:32 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:33.852104 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-75c24806-ad6d-43f8-8e50-ca4a2a90f6ac tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:33.853160 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-75c24806-ad6d-43f8-8e50-ca4a2a90f6ac tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:33.862271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75c24806-ad6d-43f8-8e50-ca4a2a90f6ac tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:33.862715 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75c24806-ad6d-43f8-8e50-ca4a2a90f6ac tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:33.863477 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75c24806-ad6d-43f8-8e50-ca4a2a90f6ac tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:33.863911 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75c24806-ad6d-43f8-8e50-ca4a2a90f6ac tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:34.006344 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-75c24806-ad6d-43f8-8e50-ca4a2a90f6ac tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:34.016718 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-75c24806-ad6d-43f8-8e50-ca4a2a90f6ac tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.171290 Jun 03 13:06:34.017618 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 183/371] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:33 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:35.036182 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a0b74c08-7f67-433b-b521-6a1ecb5f4b75 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:35.037224 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a0b74c08-7f67-433b-b521-6a1ecb5f4b75 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:35.046397 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0b74c08-7f67-433b-b521-6a1ecb5f4b75 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:35.047048 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0b74c08-7f67-433b-b521-6a1ecb5f4b75 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:35.047885 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0b74c08-7f67-433b-b521-6a1ecb5f4b75 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:35.048366 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a0b74c08-7f67-433b-b521-6a1ecb5f4b75 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:35.186523 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a0b74c08-7f67-433b-b521-6a1ecb5f4b75 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:35.197728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a0b74c08-7f67-433b-b521-6a1ecb5f4b75 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.167068 Jun 03 13:06:35.198489 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 189/372] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:35 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:35.819743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-61e3a707-5bdd-486a-9856-c5ee2fb1cc36 req-cc6568bd-ae6f-4bf6-8bed-0c604c600731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fb1319-f284-49dc-a3eb-2574997aec2f", "name": "network-vif-plugged", "status": "completed", "tag": "7d7e272d-3c3e-4fa0-8fe6-be6388ec93cb"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:06:35.823949 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:35.831268 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-61e3a707-5bdd-486a-9856-c5ee2fb1cc36 req-cc6568bd-ae6f-4bf6-8bed-0c604c600731 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:35.831762 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-61e3a707-5bdd-486a-9856-c5ee2fb1cc36 req-cc6568bd-ae6f-4bf6-8bed-0c604c600731 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:35.842846 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-61e3a707-5bdd-486a-9856-c5ee2fb1cc36 req-cc6568bd-ae6f-4bf6-8bed-0c604c600731 service nova] Creating event network-vif-plugged:7d7e272d-3c3e-4fa0-8fe6-be6388ec93cb for instance 27fb1319-f284-49dc-a3eb-2574997aec2f on hv-cinder-77954 Jun 03 13:06:35.848089 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-61e3a707-5bdd-486a-9856-c5ee2fb1cc36 req-cc6568bd-ae6f-4bf6-8bed-0c604c600731 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032456 Jun 03 13:06:35.848869 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 184/373] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:06:36.220157 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c42fc7c9-3e2e-4680-9c3a-d3cfbef1d8d4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:36.220773 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c42fc7c9-3e2e-4680-9c3a-d3cfbef1d8d4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:36.222814 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:36.223462 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=10 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:36.229169 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c42fc7c9-3e2e-4680-9c3a-d3cfbef1d8d4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:36.229615 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c42fc7c9-3e2e-4680-9c3a-d3cfbef1d8d4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:36.230414 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c42fc7c9-3e2e-4680-9c3a-d3cfbef1d8d4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:36.230850 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c42fc7c9-3e2e-4680-9c3a-d3cfbef1d8d4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:36.377860 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c42fc7c9-3e2e-4680-9c3a-d3cfbef1d8d4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:36.385881 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c42fc7c9-3e2e-4680-9c3a-d3cfbef1d8d4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.172577 Jun 03 13:06:36.386484 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 190/374] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:36 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:37.405432 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e0dfcd07-e1c0-47f4-8873-e7ffdaac3bd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:37.406330 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e0dfcd07-e1c0-47f4-8873-e7ffdaac3bd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:37.414719 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0dfcd07-e1c0-47f4-8873-e7ffdaac3bd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:37.415245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0dfcd07-e1c0-47f4-8873-e7ffdaac3bd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:37.416145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0dfcd07-e1c0-47f4-8873-e7ffdaac3bd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:37.416684 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e0dfcd07-e1c0-47f4-8873-e7ffdaac3bd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:37.555490 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e0dfcd07-e1c0-47f4-8873-e7ffdaac3bd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:37.563088 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e0dfcd07-e1c0-47f4-8873-e7ffdaac3bd3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.163234 Jun 03 13:06:37.563632 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 185/375] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:37 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:38.580561 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9869bf6b-aca1-4280-b5db-899fa77ea508 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:38.581168 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9869bf6b-aca1-4280-b5db-899fa77ea508 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:38.587694 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9869bf6b-aca1-4280-b5db-899fa77ea508 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:38.588148 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9869bf6b-aca1-4280-b5db-899fa77ea508 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:38.588904 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9869bf6b-aca1-4280-b5db-899fa77ea508 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:38.589334 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9869bf6b-aca1-4280-b5db-899fa77ea508 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:38.730800 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9869bf6b-aca1-4280-b5db-899fa77ea508 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:38.738932 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9869bf6b-aca1-4280-b5db-899fa77ea508 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.162435 Jun 03 13:06:38.739626 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 191/376] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:38 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:39.760678 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-29edd7a2-8097-4c18-9780-9e14494023af tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:39.761679 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-29edd7a2-8097-4c18-9780-9e14494023af tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:39.770695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-29edd7a2-8097-4c18-9780-9e14494023af tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:39.771282 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-29edd7a2-8097-4c18-9780-9e14494023af tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:39.772055 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-29edd7a2-8097-4c18-9780-9e14494023af tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:39.772488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-29edd7a2-8097-4c18-9780-9e14494023af tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:39.904866 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-29edd7a2-8097-4c18-9780-9e14494023af tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:39.912823 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-29edd7a2-8097-4c18-9780-9e14494023af tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.158915 Jun 03 13:06:39.913400 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 186/377] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:39 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:06:40.928924 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-75428117-a367-48a5-b937-4773d40f9bcd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:40.929533 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-75428117-a367-48a5-b937-4773d40f9bcd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:40.935683 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75428117-a367-48a5-b937-4773d40f9bcd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:40.936124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75428117-a367-48a5-b937-4773d40f9bcd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:40.936882 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75428117-a367-48a5-b937-4773d40f9bcd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:40.937313 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75428117-a367-48a5-b937-4773d40f9bcd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:41.083377 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-75428117-a367-48a5-b937-4773d40f9bcd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:41.091366 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-75428117-a367-48a5-b937-4773d40f9bcd tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.166316 Jun 03 13:06:41.091935 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 192/378] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:40 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:42.111842 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-03bb0a7f-d83d-4b1a-a62b-348a9c5ca22e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:42.112470 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-03bb0a7f-d83d-4b1a-a62b-348a9c5ca22e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:42.121507 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03bb0a7f-d83d-4b1a-a62b-348a9c5ca22e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:42.122401 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03bb0a7f-d83d-4b1a-a62b-348a9c5ca22e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:42.123262 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03bb0a7f-d83d-4b1a-a62b-348a9c5ca22e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:42.123694 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03bb0a7f-d83d-4b1a-a62b-348a9c5ca22e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:42.256695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-03bb0a7f-d83d-4b1a-a62b-348a9c5ca22e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:42.264419 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-03bb0a7f-d83d-4b1a-a62b-348a9c5ca22e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.159268 Jun 03 13:06:42.264992 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 187/379] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:42 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:43.285810 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6922f8d5-9678-4dcd-bd15-8cc5e66b454d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:43.286760 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6922f8d5-9678-4dcd-bd15-8cc5e66b454d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:43.296835 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6922f8d5-9678-4dcd-bd15-8cc5e66b454d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:43.297571 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6922f8d5-9678-4dcd-bd15-8cc5e66b454d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:43.298940 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6922f8d5-9678-4dcd-bd15-8cc5e66b454d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:43.299372 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6922f8d5-9678-4dcd-bd15-8cc5e66b454d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:43.452243 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6922f8d5-9678-4dcd-bd15-8cc5e66b454d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:43.460037 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6922f8d5-9678-4dcd-bd15-8cc5e66b454d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.180908 Jun 03 13:06:43.460636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 193/380] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:43 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:44.481347 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8d8668f5-bc04-4aee-a108-5e13ba7e80b0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:44.482394 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8d8668f5-bc04-4aee-a108-5e13ba7e80b0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:44.493044 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d8668f5-bc04-4aee-a108-5e13ba7e80b0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:44.493743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d8668f5-bc04-4aee-a108-5e13ba7e80b0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:44.494958 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d8668f5-bc04-4aee-a108-5e13ba7e80b0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:44.495624 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d8668f5-bc04-4aee-a108-5e13ba7e80b0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:44.644780 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8d8668f5-bc04-4aee-a108-5e13ba7e80b0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:44.656214 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8d8668f5-bc04-4aee-a108-5e13ba7e80b0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1367 microversion: 2.1 time: 0.181237 Jun 03 13:06:44.657164 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 188/381] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:44 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:45.675024 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d1be32af-7f6f-466d-8f16-76527a3aad17 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:45.675639 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d1be32af-7f6f-466d-8f16-76527a3aad17 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:45.677633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:45.683595 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1be32af-7f6f-466d-8f16-76527a3aad17 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:45.684018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1be32af-7f6f-466d-8f16-76527a3aad17 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:45.684795 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1be32af-7f6f-466d-8f16-76527a3aad17 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:45.685232 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1be32af-7f6f-466d-8f16-76527a3aad17 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:45.830158 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d1be32af-7f6f-466d-8f16-76527a3aad17 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:45.837934 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d1be32af-7f6f-466d-8f16-76527a3aad17 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1556 microversion: 2.1 time: 0.168395 Jun 03 13:06:45.838541 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 194/382] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:45 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:45.857404 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-09bf51f2-0786-4ed6-a58c-a0a68bd6e85b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:45.857931 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-09bf51f2-0786-4ed6-a58c-a0a68bd6e85b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:45.861667 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=27 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:45.869299 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09bf51f2-0786-4ed6-a58c-a0a68bd6e85b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:45.869922 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09bf51f2-0786-4ed6-a58c-a0a68bd6e85b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:45.871095 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09bf51f2-0786-4ed6-a58c-a0a68bd6e85b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:45.871679 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-09bf51f2-0786-4ed6-a58c-a0a68bd6e85b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:45.875400 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:45.955759 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-09bf51f2-0786-4ed6-a58c-a0a68bd6e85b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104028 Jun 03 13:06:45.956672 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 189/383] 10.222.0.58 () {58 vars in 1274 bytes} [Fri Jun 3 13:06:45 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:06:46.891745 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-257add80-1c2f-4768-a843-54628e48f0fe req-782f4a73-e0ea-435e-a5bb-965ee0971b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fb1319-f284-49dc-a3eb-2574997aec2f", "tag": "7d7e272d-3c3e-4fa0-8fe6-be6388ec93cb"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:06:46.900819 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-257add80-1c2f-4768-a843-54628e48f0fe req-782f4a73-e0ea-435e-a5bb-965ee0971b2e service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:46.901244 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-257add80-1c2f-4768-a843-54628e48f0fe req-782f4a73-e0ea-435e-a5bb-965ee0971b2e service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:46.912699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-257add80-1c2f-4768-a843-54628e48f0fe req-782f4a73-e0ea-435e-a5bb-965ee0971b2e service nova] Creating event network-changed:7d7e272d-3c3e-4fa0-8fe6-be6388ec93cb for instance 27fb1319-f284-49dc-a3eb-2574997aec2f on hv-cinder-77954 Jun 03 13:06:46.917928 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-257add80-1c2f-4768-a843-54628e48f0fe req-782f4a73-e0ea-435e-a5bb-965ee0971b2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029940 Jun 03 13:06:46.918545 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 195/384] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:06:54.818413 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d5a378d1-33ac-4efa-a48a-c3c619937c11 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:54.818935 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d5a378d1-33ac-4efa-a48a-c3c619937c11 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:54.826432 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5a378d1-33ac-4efa-a48a-c3c619937c11 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:54.826873 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5a378d1-33ac-4efa-a48a-c3c619937c11 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:54.827629 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5a378d1-33ac-4efa-a48a-c3c619937c11 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:54.828052 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d5a378d1-33ac-4efa-a48a-c3c619937c11 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:54.966706 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-d5a378d1-33ac-4efa-a48a-c3c619937c11 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lazy-loading 'services' on Instance uuid e08e917b-319c-4a53-b3b2-ccfc64195c64 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:06:55.097232 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d5a378d1-33ac-4efa-a48a-c3c619937c11 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64/os-volume_attachments/179884c9-f9d9-405a-9009-c40d4d1ccabf" status: 202 len: 0 microversion: 2.1 time: 0.286147 Jun 03 13:06:55.097853 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 190/385] 10.222.0.58 () {58 vars in 1415 bytes} [Fri Jun 3 13:06:54 2022] DELETE /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64/os-volume_attachments/179884c9-f9d9-405a-9009-c40d4d1ccabf => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:06:56.219177 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-74d6fca5-2222-4b78-8f85-5c4de42f53c7 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:56.219778 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-74d6fca5-2222-4b78-8f85-5c4de42f53c7 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:56.226566 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74d6fca5-2222-4b78-8f85-5c4de42f53c7 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:56.227015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74d6fca5-2222-4b78-8f85-5c4de42f53c7 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:56.227793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74d6fca5-2222-4b78-8f85-5c4de42f53c7 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:56.228234 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74d6fca5-2222-4b78-8f85-5c4de42f53c7 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:56.230903 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=61 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:06:56.254365 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-74d6fca5-2222-4b78-8f85-5c4de42f53c7 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:06:56.337422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-74d6fca5-2222-4b78-8f85-5c4de42f53c7 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 204 len: 0 microversion: 2.1 time: 0.122220 Jun 03 13:06:56.338221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 196/386] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:06:56 2022] DELETE /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:06:56.347828 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a57234df-8551-4e1d-acf7-41812e98affb tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:56.348616 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a57234df-8551-4e1d-acf7-41812e98affb tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:56.355035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a57234df-8551-4e1d-acf7-41812e98affb tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:56.355487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a57234df-8551-4e1d-acf7-41812e98affb tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:56.356291 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a57234df-8551-4e1d-acf7-41812e98affb tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:56.356719 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a57234df-8551-4e1d-acf7-41812e98affb tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:56.492381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a57234df-8551-4e1d-acf7-41812e98affb tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:56.500601 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a57234df-8551-4e1d-acf7-41812e98affb tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1515 microversion: 2.1 time: 0.157493 Jun 03 13:06:56.501186 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 191/387] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:56 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:06:57.523787 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6b47285b-b51f-45fb-b15b-54e15a04265a tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:57.524958 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6b47285b-b51f-45fb-b15b-54e15a04265a tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:57.531999 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b47285b-b51f-45fb-b15b-54e15a04265a tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:57.532448 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b47285b-b51f-45fb-b15b-54e15a04265a tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:57.533214 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b47285b-b51f-45fb-b15b-54e15a04265a tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:57.533669 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6b47285b-b51f-45fb-b15b-54e15a04265a tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:57.666980 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6b47285b-b51f-45fb-b15b-54e15a04265a tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:57.675077 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6b47285b-b51f-45fb-b15b-54e15a04265a tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1515 microversion: 2.1 time: 0.158466 Jun 03 13:06:57.675640 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 197/388] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:57 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:58.693152 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c4a1a2fe-566a-40fc-9fc1-37d75b915960 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:06:58.693742 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c4a1a2fe-566a-40fc-9fc1-37d75b915960 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:06:58.700872 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4a1a2fe-566a-40fc-9fc1-37d75b915960 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:58.701321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4a1a2fe-566a-40fc-9fc1-37d75b915960 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:58.702057 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4a1a2fe-566a-40fc-9fc1-37d75b915960 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:58.702553 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4a1a2fe-566a-40fc-9fc1-37d75b915960 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:58.965124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-8b6fccfc-185c-47fb-bab8-7ac3a5f6a7b1 req-6ca00eef-b656-4179-9673-b63bd5268c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e08e917b-319c-4a53-b3b2-ccfc64195c64", "name": "network-vif-deleted", "tag": "1bee1e74-e70b-441b-82e0-9cd1ef130dc1"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:06:58.967052 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c4a1a2fe-566a-40fc-9fc1-37d75b915960 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:06:58.974377 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8b6fccfc-185c-47fb-bab8-7ac3a5f6a7b1 req-6ca00eef-b656-4179-9673-b63bd5268c0e service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:06:58.974823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8b6fccfc-185c-47fb-bab8-7ac3a5f6a7b1 req-6ca00eef-b656-4179-9673-b63bd5268c0e service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:06:58.976085 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c4a1a2fe-566a-40fc-9fc1-37d75b915960 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 200 len: 1515 microversion: 2.1 time: 0.287057 Jun 03 13:06:58.976769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 192/389] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:58 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 1515 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:06:58.987587 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-8b6fccfc-185c-47fb-bab8-7ac3a5f6a7b1 req-6ca00eef-b656-4179-9673-b63bd5268c0e service nova] Creating event network-vif-deleted:1bee1e74-e70b-441b-82e0-9cd1ef130dc1 for instance e08e917b-319c-4a53-b3b2-ccfc64195c64 on hv-cinder-77954 Jun 03 13:06:58.992707 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-8b6fccfc-185c-47fb-bab8-7ac3a5f6a7b1 req-6ca00eef-b656-4179-9673-b63bd5268c0e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031661 Jun 03 13:06:58.993514 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 198/390] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:06:59.999157 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5f6907a3-7bab-4a39-9287-f54896ae3210 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:00.000089 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5f6907a3-7bab-4a39-9287-f54896ae3210 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: e08e917b-319c-4a53-b3b2-ccfc64195c64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:00.011272 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5f6907a3-7bab-4a39-9287-f54896ae3210 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:00.011733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5f6907a3-7bab-4a39-9287-f54896ae3210 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:00.012509 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5f6907a3-7bab-4a39-9287-f54896ae3210 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:00.012951 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5f6907a3-7bab-4a39-9287-f54896ae3210 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:00.027113 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-5f6907a3-7bab-4a39-9287-f54896ae3210 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] HTTP exception thrown: Instance e08e917b-319c-4a53-b3b2-ccfc64195c64 could not be found. Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5f6907a3-7bab-4a39-9287-f54896ae3210 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Request method failure captured: Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 HTTP/1.1 Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgconb-hnGi5T0uwIvjvtQR75chmGsXAxXWiGlGPPsNeXYeXLsxisKxte0zAXs03Un1LzUU749xGwP6d9Vff5RK7Q0O5WqDjH0CsOwg9WWQRUGpP6heR0FPwrteDK5FfIy9_vfls0kCnWLdqx14yaC5tNJyKiLpV5RDxfkZWZUnpbmE Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: b579f36c6162451daa31ad27aa97a083 Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2034862311 Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:07:00.028733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:07:00.030208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b579f36c6162451daa31ad27aa97a083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b579f36c6162451daa31ad27aa97a083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b579f36c6162451daa31ad27aa97a083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b579f36c6162451daa31ad27aa97a083"}]}] Jun 03 13:07:00.030208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesSnapshotTestJSON-2034862311 Jun 03 13:07:00.030208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: b579f36c6162451daa31ad27aa97a083 Jun 03 13:07:00.030208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2034862311 Jun 03 13:07:00.030208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesSnapshotTestJSON-2034862311-project Jun 03 13:07:00.030208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:07:00.030208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:07:00.030208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 50ff2e53a17c4052a08ebe104034ab80 Jun 03 13:07:00.030208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesSnapshotTestJSON-2034862311-project Jun 03 13:07:00.030208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:07:00.030208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance e08e917b-319c-4a53-b3b2-ccfc64195c64 could not be found. Jun 03 13:07:00.030208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': 'e08e917b-319c-4a53-b3b2-ccfc64195c64'} Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e08e917b-319c-4a53-b3b2-ccfc64195c64 could not be found. Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:07:00.031067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e08e917b-319c-4a53-b3b2-ccfc64195c64 could not be found. Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e08e917b-319c-4a53-b3b2-ccfc64195c64 could not be found. Jun 03 13:07:00.032492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:07:00.033754 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5f6907a3-7bab-4a39-9287-f54896ae3210 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Returning 404 to user: Instance e08e917b-319c-4a53-b3b2-ccfc64195c64 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:07:00.033754 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5f6907a3-7bab-4a39-9287-f54896ae3210 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64" status: 404 len: 111 microversion: 2.1 time: 0.038432 Jun 03 13:07:00.033754 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 193/391] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:06:59 2022] GET /compute/v2.1/servers/e08e917b-319c-4a53-b3b2-ccfc64195c64 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:07:04.698186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-acc3e511-2cca-49f6-acb3-a52ad7484e1b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:07:04.699177 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-acc3e511-2cca-49f6-acb3-a52ad7484e1b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:04.706221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-acc3e511-2cca-49f6-acb3-a52ad7484e1b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:04.706677 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-acc3e511-2cca-49f6-acb3-a52ad7484e1b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:04.707459 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-acc3e511-2cca-49f6-acb3-a52ad7484e1b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:04.707900 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-acc3e511-2cca-49f6-acb3-a52ad7484e1b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:04.786407 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-acc3e511-2cca-49f6-acb3-a52ad7484e1b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "POST /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/action" status: 202 len: 0 microversion: 2.1 time: 0.094872 Jun 03 13:07:04.787123 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 199/392] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:07:04 2022] POST /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:07:04.795907 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7ebecece-bb16-4730-9c54-22d4982a2d75 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:04.796533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7ebecece-bb16-4730-9c54-22d4982a2d75 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:04.803753 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7ebecece-bb16-4730-9c54-22d4982a2d75 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:04.804228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7ebecece-bb16-4730-9c54-22d4982a2d75 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:04.805000 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7ebecece-bb16-4730-9c54-22d4982a2d75 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:04.805422 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7ebecece-bb16-4730-9c54-22d4982a2d75 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:05.254694 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7ebecece-bb16-4730-9c54-22d4982a2d75 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:05.263017 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7ebecece-bb16-4730-9c54-22d4982a2d75 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1751 microversion: 2.1 time: 0.471187 Jun 03 13:07:05.263788 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 194/393] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:04 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1751 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:06.284919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-402f32ac-f273-41c0-b078-6298ad6373d3 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:06.286096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-402f32ac-f273-41c0-b078-6298ad6373d3 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:06.297168 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-402f32ac-f273-41c0-b078-6298ad6373d3 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:06.297917 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-402f32ac-f273-41c0-b078-6298ad6373d3 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:06.299231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-402f32ac-f273-41c0-b078-6298ad6373d3 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:06.299945 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-402f32ac-f273-41c0-b078-6298ad6373d3 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:06.455509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-402f32ac-f273-41c0-b078-6298ad6373d3 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:06.465376 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-402f32ac-f273-41c0-b078-6298ad6373d3 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1756 microversion: 2.1 time: 0.187601 Jun 03 13:07:06.465939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 200/394] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:06 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:07.485068 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-864bdd46-27db-449d-b1d5-38ae3bc2b333 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:07.486238 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-864bdd46-27db-449d-b1d5-38ae3bc2b333 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:07.495307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-864bdd46-27db-449d-b1d5-38ae3bc2b333 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:07.495914 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-864bdd46-27db-449d-b1d5-38ae3bc2b333 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:07.496935 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-864bdd46-27db-449d-b1d5-38ae3bc2b333 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:07.497517 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-864bdd46-27db-449d-b1d5-38ae3bc2b333 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:07.653576 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-864bdd46-27db-449d-b1d5-38ae3bc2b333 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:07.662168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-864bdd46-27db-449d-b1d5-38ae3bc2b333 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1756 microversion: 2.1 time: 0.182328 Jun 03 13:07:07.662794 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 195/395] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:07 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:08.683387 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-45f59a87-bcd6-48e1-a35a-ba34a25ab190 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:08.683927 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-45f59a87-bcd6-48e1-a35a-ba34a25ab190 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:08.690573 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45f59a87-bcd6-48e1-a35a-ba34a25ab190 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:08.691019 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45f59a87-bcd6-48e1-a35a-ba34a25ab190 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:08.691780 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45f59a87-bcd6-48e1-a35a-ba34a25ab190 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:08.692210 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45f59a87-bcd6-48e1-a35a-ba34a25ab190 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:08.843669 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-45f59a87-bcd6-48e1-a35a-ba34a25ab190 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:08.851725 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-45f59a87-bcd6-48e1-a35a-ba34a25ab190 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1756 microversion: 2.1 time: 0.175056 Jun 03 13:07:08.852286 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 201/396] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:08 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:09.873939 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-107b0d4a-989d-4dbe-a29f-ed34f9ef0371 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:09.875008 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-107b0d4a-989d-4dbe-a29f-ed34f9ef0371 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:09.887099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-107b0d4a-989d-4dbe-a29f-ed34f9ef0371 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:09.887586 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-107b0d4a-989d-4dbe-a29f-ed34f9ef0371 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:09.888406 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-107b0d4a-989d-4dbe-a29f-ed34f9ef0371 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:09.888966 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-107b0d4a-989d-4dbe-a29f-ed34f9ef0371 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:10.050217 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-107b0d4a-989d-4dbe-a29f-ed34f9ef0371 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:10.059046 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-107b0d4a-989d-4dbe-a29f-ed34f9ef0371 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1756 microversion: 2.1 time: 0.192106 Jun 03 13:07:10.059631 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 196/397] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:09 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:11.080823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-69f9346e-b897-48f8-9498-50d3ff6ad941 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:11.081763 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-69f9346e-b897-48f8-9498-50d3ff6ad941 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:11.091175 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-69f9346e-b897-48f8-9498-50d3ff6ad941 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:11.091658 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-69f9346e-b897-48f8-9498-50d3ff6ad941 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:11.092456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-69f9346e-b897-48f8-9498-50d3ff6ad941 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:11.092894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-69f9346e-b897-48f8-9498-50d3ff6ad941 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:11.244430 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-69f9346e-b897-48f8-9498-50d3ff6ad941 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:11.253182 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-69f9346e-b897-48f8-9498-50d3ff6ad941 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1756 microversion: 2.1 time: 0.179083 Jun 03 13:07:11.253785 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 202/398] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:11 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:12.148496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-92134030", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "networks": [{"uuid": "6fd9d9aa-f28d-4116-ab9d-c85867765f0e"}]}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:07:12.212376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] validate_networks() for [('6fd9d9aa-f28d-4116-ab9d-c85867765f0e', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:07:12.270793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e7a6100d-8d85-4cb9-ab06-fdbd078ab7dd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:12.271384 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e7a6100d-8d85-4cb9-ab06-fdbd078ab7dd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:12.277759 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e7a6100d-8d85-4cb9-ab06-fdbd078ab7dd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:12.278239 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e7a6100d-8d85-4cb9-ab06-fdbd078ab7dd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:12.279008 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e7a6100d-8d85-4cb9-ab06-fdbd078ab7dd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:12.279435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e7a6100d-8d85-4cb9-ab06-fdbd078ab7dd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:12.521690 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e7a6100d-8d85-4cb9-ab06-fdbd078ab7dd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:12.530718 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e7a6100d-8d85-4cb9-ab06-fdbd078ab7dd tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1756 microversion: 2.1 time: 0.263816 Jun 03 13:07:12.531513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 203/399] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:12 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1756 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:12.657288 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:07:12.657886 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:07:12.658735 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:07:12.659435 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:07:12.660105 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:07:12.672429 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:12.672879 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:12.673675 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:12.674140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:12.693414 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Getting quotas for project b579f36c6162451daa31ad27aa97a083. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:07:12.699316 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Getting quotas for user 50ff2e53a17c4052a08ebe104034ab80 and project b579f36c6162451daa31ad27aa97a083. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:07:12.714948 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:07:12.718596 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:07:12.779239 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-eda7a261-adf9-4f6b-a30e-cb9b32a3950e tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637128 Jun 03 13:07:12.780122 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 197/400] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:07:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:07:12.790848 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-74241412-b893-4dc7-be92-1c94ce827519 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:12.791458 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-74241412-b893-4dc7-be92-1c94ce827519 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:12.848993 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-74241412-b893-4dc7-be92-1c94ce827519 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:12.856985 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-74241412-b893-4dc7-be92-1c94ce827519 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1217 microversion: 2.1 time: 0.070001 Jun 03 13:07:12.858355 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 204/401] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:12 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:13.549924 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f486dd55-1d5c-4825-a540-3ddae0cb136c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:13.550577 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f486dd55-1d5c-4825-a540-3ddae0cb136c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:13.557757 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f486dd55-1d5c-4825-a540-3ddae0cb136c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:13.558306 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f486dd55-1d5c-4825-a540-3ddae0cb136c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:13.560764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f486dd55-1d5c-4825-a540-3ddae0cb136c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:13.561219 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f486dd55-1d5c-4825-a540-3ddae0cb136c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:13.715661 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f486dd55-1d5c-4825-a540-3ddae0cb136c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:13.723902 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f486dd55-1d5c-4825-a540-3ddae0cb136c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1756 microversion: 2.1 time: 0.178460 Jun 03 13:07:13.724481 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 198/402] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:13 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:13.875340 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d8f5b3fd-5947-486d-b9bf-30badaeedd3d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:13.875895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d8f5b3fd-5947-486d-b9bf-30badaeedd3d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:13.882029 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8f5b3fd-5947-486d-b9bf-30badaeedd3d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:13.882722 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8f5b3fd-5947-486d-b9bf-30badaeedd3d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:13.883492 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8f5b3fd-5947-486d-b9bf-30badaeedd3d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:13.883921 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d8f5b3fd-5947-486d-b9bf-30badaeedd3d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:13.990895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d8f5b3fd-5947-486d-b9bf-30badaeedd3d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:13.998593 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d8f5b3fd-5947-486d-b9bf-30badaeedd3d tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1287 microversion: 2.1 time: 0.127326 Jun 03 13:07:13.999133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 205/403] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:13 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1287 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:14.741980 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7703f1c4-355e-4827-a890-cf5e35b16046 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:14.742651 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7703f1c4-355e-4827-a890-cf5e35b16046 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:14.749741 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7703f1c4-355e-4827-a890-cf5e35b16046 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:14.750216 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7703f1c4-355e-4827-a890-cf5e35b16046 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:14.750976 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7703f1c4-355e-4827-a890-cf5e35b16046 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:14.751407 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7703f1c4-355e-4827-a890-cf5e35b16046 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:14.965903 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7703f1c4-355e-4827-a890-cf5e35b16046 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:14.975495 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7703f1c4-355e-4827-a890-cf5e35b16046 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1756 microversion: 2.1 time: 0.237365 Jun 03 13:07:14.976069 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 199/404] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:14 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:15.017365 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5dd104a9-92e4-470d-81f0-6052483b7097 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:15.018574 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5dd104a9-92e4-470d-81f0-6052483b7097 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:15.025704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5dd104a9-92e4-470d-81f0-6052483b7097 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:15.026224 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5dd104a9-92e4-470d-81f0-6052483b7097 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:15.027006 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5dd104a9-92e4-470d-81f0-6052483b7097 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:15.027439 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5dd104a9-92e4-470d-81f0-6052483b7097 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:15.216408 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5dd104a9-92e4-470d-81f0-6052483b7097 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:15.225024 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5dd104a9-92e4-470d-81f0-6052483b7097 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1317 microversion: 2.1 time: 0.212592 Jun 03 13:07:15.225587 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 206/405] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:15 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:15.276274 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-d7b4ca7c-833d-4ccb-b47d-a03c179d7a71 req-91cd1e65-febe-4705-893f-39d02f1482dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490", "tag": "a0bca9d5-fcf6-4098-923a-a0f922318083"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:07:15.285843 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-d7b4ca7c-833d-4ccb-b47d-a03c179d7a71 req-91cd1e65-febe-4705-893f-39d02f1482dd service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:15.286798 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-d7b4ca7c-833d-4ccb-b47d-a03c179d7a71 req-91cd1e65-febe-4705-893f-39d02f1482dd service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:15.298087 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-d7b4ca7c-833d-4ccb-b47d-a03c179d7a71 req-91cd1e65-febe-4705-893f-39d02f1482dd service nova] Creating event network-changed:a0bca9d5-fcf6-4098-923a-a0f922318083 for instance 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 on hv-cinder-77954 Jun 03 13:07:15.303095 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-d7b4ca7c-833d-4ccb-b47d-a03c179d7a71 req-91cd1e65-febe-4705-893f-39d02f1482dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031038 Jun 03 13:07:15.303713 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 200/406] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:07:15.996750 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4a9d22db-9058-4f46-963f-9e59bc9c0c9f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:15.997514 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4a9d22db-9058-4f46-963f-9e59bc9c0c9f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:15.999950 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:16.006588 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a9d22db-9058-4f46-963f-9e59bc9c0c9f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:16.007154 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a9d22db-9058-4f46-963f-9e59bc9c0c9f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:16.008128 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a9d22db-9058-4f46-963f-9e59bc9c0c9f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:16.008674 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a9d22db-9058-4f46-963f-9e59bc9c0c9f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:16.177387 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4a9d22db-9058-4f46-963f-9e59bc9c0c9f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:16.187784 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4a9d22db-9058-4f46-963f-9e59bc9c0c9f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1756 microversion: 2.1 time: 0.197448 Jun 03 13:07:16.188357 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 207/407] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:15 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:16.243675 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8cf34863-cb59-4dcf-a86e-9072358ddb55 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:16.244361 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8cf34863-cb59-4dcf-a86e-9072358ddb55 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:16.246416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:16.252156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8cf34863-cb59-4dcf-a86e-9072358ddb55 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:16.252528 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8cf34863-cb59-4dcf-a86e-9072358ddb55 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:16.253289 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8cf34863-cb59-4dcf-a86e-9072358ddb55 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:16.253712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8cf34863-cb59-4dcf-a86e-9072358ddb55 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:16.256703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:16.393057 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8cf34863-cb59-4dcf-a86e-9072358ddb55 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:16.401561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8cf34863-cb59-4dcf-a86e-9072358ddb55 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1317 microversion: 2.1 time: 0.162257 Jun 03 13:07:16.402306 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 201/408] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:16 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:17.206014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-45a64893-379e-495e-8cd3-0bdf3c4c211c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:17.206622 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-45a64893-379e-495e-8cd3-0bdf3c4c211c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:17.213446 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45a64893-379e-495e-8cd3-0bdf3c4c211c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:17.213908 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45a64893-379e-495e-8cd3-0bdf3c4c211c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:17.214714 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45a64893-379e-495e-8cd3-0bdf3c4c211c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:17.215158 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-45a64893-379e-495e-8cd3-0bdf3c4c211c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:17.420142 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a1abc147-6ad2-413c-8d1b-4bce825904b4 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:17.420768 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a1abc147-6ad2-413c-8d1b-4bce825904b4 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:17.427550 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1abc147-6ad2-413c-8d1b-4bce825904b4 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:17.427980 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1abc147-6ad2-413c-8d1b-4bce825904b4 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:17.428741 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1abc147-6ad2-413c-8d1b-4bce825904b4 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:17.429311 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a1abc147-6ad2-413c-8d1b-4bce825904b4 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:17.657012 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-45a64893-379e-495e-8cd3-0bdf3c4c211c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:17.665409 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-45a64893-379e-495e-8cd3-0bdf3c4c211c tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1756 microversion: 2.1 time: 0.463356 Jun 03 13:07:17.666081 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 208/409] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:17 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1756 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:17.693514 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a1abc147-6ad2-413c-8d1b-4bce825904b4 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:17.701446 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a1abc147-6ad2-413c-8d1b-4bce825904b4 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1317 microversion: 2.1 time: 0.286148 Jun 03 13:07:17.702032 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 202/410] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:17 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:18.687158 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8e10b0e1-ae97-4b12-ab87-4cf9d083046b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:18.688055 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8e10b0e1-ae97-4b12-ab87-4cf9d083046b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:18.698495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e10b0e1-ae97-4b12-ab87-4cf9d083046b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:18.699419 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e10b0e1-ae97-4b12-ab87-4cf9d083046b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:18.700205 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e10b0e1-ae97-4b12-ab87-4cf9d083046b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:18.700557 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8e10b0e1-ae97-4b12-ab87-4cf9d083046b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:18.723766 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d950a442-3f0c-4fb1-9d44-82f3af49399c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:18.725068 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d950a442-3f0c-4fb1-9d44-82f3af49399c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:18.732529 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d950a442-3f0c-4fb1-9d44-82f3af49399c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:18.732978 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d950a442-3f0c-4fb1-9d44-82f3af49399c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:18.734015 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d950a442-3f0c-4fb1-9d44-82f3af49399c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:18.734476 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d950a442-3f0c-4fb1-9d44-82f3af49399c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:19.002290 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8e10b0e1-ae97-4b12-ab87-4cf9d083046b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:19.010563 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8e10b0e1-ae97-4b12-ab87-4cf9d083046b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1756 microversion: 2.1 time: 0.330152 Jun 03 13:07:19.011140 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 209/411] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:18 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1756 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:19.018369 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d950a442-3f0c-4fb1-9d44-82f3af49399c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:19.026144 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d950a442-3f0c-4fb1-9d44-82f3af49399c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1317 microversion: 2.1 time: 0.306581 Jun 03 13:07:19.026793 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 203/412] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:18 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:20.027378 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5b0c5fa9-899d-4e4f-9c3f-ef6cb431798a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:20.028726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5b0c5fa9-899d-4e4f-9c3f-ef6cb431798a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:20.035238 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b0c5fa9-899d-4e4f-9c3f-ef6cb431798a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:20.035683 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b0c5fa9-899d-4e4f-9c3f-ef6cb431798a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:20.036470 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b0c5fa9-899d-4e4f-9c3f-ef6cb431798a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:20.037655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5b0c5fa9-899d-4e4f-9c3f-ef6cb431798a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:20.044922 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-78b7cef3-eb60-4e15-b2c8-b48cfa1785c6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:20.045534 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-78b7cef3-eb60-4e15-b2c8-b48cfa1785c6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:20.051827 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-78b7cef3-eb60-4e15-b2c8-b48cfa1785c6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:20.052281 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-78b7cef3-eb60-4e15-b2c8-b48cfa1785c6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:20.053051 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-78b7cef3-eb60-4e15-b2c8-b48cfa1785c6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:20.053544 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-78b7cef3-eb60-4e15-b2c8-b48cfa1785c6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:20.351060 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-78b7cef3-eb60-4e15-b2c8-b48cfa1785c6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:20.359097 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-78b7cef3-eb60-4e15-b2c8-b48cfa1785c6 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1317 microversion: 2.1 time: 0.319106 Jun 03 13:07:20.359651 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 204/413] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:20 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:07:20.370512 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5b0c5fa9-899d-4e4f-9c3f-ef6cb431798a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:20.379824 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5b0c5fa9-899d-4e4f-9c3f-ef6cb431798a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1759 microversion: 2.1 time: 0.356379 Jun 03 13:07:20.380405 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 210/414] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:20 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1759 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:20.881268 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-dfd7810a-28af-4239-9a9b-be3703b6cb9b req-ffbcb942-f19a-4a81-aec8-ce47c0e85d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490", "name": "network-vif-plugged", "status": "completed", "tag": "a0bca9d5-fcf6-4098-923a-a0f922318083"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:07:20.889694 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-dfd7810a-28af-4239-9a9b-be3703b6cb9b req-ffbcb942-f19a-4a81-aec8-ce47c0e85d8c service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:20.890153 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-dfd7810a-28af-4239-9a9b-be3703b6cb9b req-ffbcb942-f19a-4a81-aec8-ce47c0e85d8c service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:20.901955 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-dfd7810a-28af-4239-9a9b-be3703b6cb9b req-ffbcb942-f19a-4a81-aec8-ce47c0e85d8c service nova] Creating event network-vif-plugged:a0bca9d5-fcf6-4098-923a-a0f922318083 for instance 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 on hv-cinder-77954 Jun 03 13:07:20.908984 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-dfd7810a-28af-4239-9a9b-be3703b6cb9b req-ffbcb942-f19a-4a81-aec8-ce47c0e85d8c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031019 Jun 03 13:07:20.910057 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 205/415] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:07:21.380541 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-889f5264-dff3-4712-82ea-28df7739309c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:21.381411 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-889f5264-dff3-4712-82ea-28df7739309c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:21.391793 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-889f5264-dff3-4712-82ea-28df7739309c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:21.392737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-889f5264-dff3-4712-82ea-28df7739309c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:21.394025 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-889f5264-dff3-4712-82ea-28df7739309c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:21.394808 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-889f5264-dff3-4712-82ea-28df7739309c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:21.545660 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-889f5264-dff3-4712-82ea-28df7739309c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:21.547965 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:21.555085 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-889f5264-dff3-4712-82ea-28df7739309c tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1317 microversion: 2.1 time: 0.181237 Jun 03 13:07:21.555637 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 211/416] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:21 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:22.576014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a387ba09-c53e-43a0-b2f3-a9770a108768 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:22.576740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a387ba09-c53e-43a0-b2f3-a9770a108768 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:22.583921 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a387ba09-c53e-43a0-b2f3-a9770a108768 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:22.584368 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a387ba09-c53e-43a0-b2f3-a9770a108768 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:22.585130 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a387ba09-c53e-43a0-b2f3-a9770a108768 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:22.585564 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a387ba09-c53e-43a0-b2f3-a9770a108768 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:22.681833 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:22.708630 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:22.730829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a387ba09-c53e-43a0-b2f3-a9770a108768 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:22.740288 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a387ba09-c53e-43a0-b2f3-a9770a108768 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1317 microversion: 2.1 time: 0.169985 Jun 03 13:07:22.740863 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 206/417] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:22 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:23.761725 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6e62aef2-44f6-42bb-bb41-d5580218a661 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:23.763657 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6e62aef2-44f6-42bb-bb41-d5580218a661 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:23.767121 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:23.777052 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e62aef2-44f6-42bb-bb41-d5580218a661 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:23.778283 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e62aef2-44f6-42bb-bb41-d5580218a661 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:23.779078 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e62aef2-44f6-42bb-bb41-d5580218a661 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:23.779516 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e62aef2-44f6-42bb-bb41-d5580218a661 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:23.915453 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6e62aef2-44f6-42bb-bb41-d5580218a661 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:23.924029 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6e62aef2-44f6-42bb-bb41-d5580218a661 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1506 microversion: 2.1 time: 0.168840 Jun 03 13:07:23.924599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 212/418] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:23 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:23.940918 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ce3453f9-f001-4c50-9952-f1a74e6474a1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db011e96-95c8-4d8a-a57c-044227034d08", "device": "/dev/sdb"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:07:23.942045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ce3453f9-f001-4c50-9952-f1a74e6474a1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:23.948894 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ce3453f9-f001-4c50-9952-f1a74e6474a1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:23.949552 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ce3453f9-f001-4c50-9952-f1a74e6474a1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:23.950787 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ce3453f9-f001-4c50-9952-f1a74e6474a1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:23.951221 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ce3453f9-f001-4c50-9952-f1a74e6474a1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:24.220387 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ce3453f9-f001-4c50-9952-f1a74e6474a1 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "POST /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283293 Jun 03 13:07:24.220978 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 207/419] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:07:23 2022] POST /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:07:45.843726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8859661a-1c21-411b-8a0e-c739d759aed8 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:45.844548 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8859661a-1c21-411b-8a0e-c739d759aed8 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:45.847368 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=11 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:45.848130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=7 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:45.855528 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8859661a-1c21-411b-8a0e-c739d759aed8 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:45.855973 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8859661a-1c21-411b-8a0e-c739d759aed8 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:45.856736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8859661a-1c21-411b-8a0e-c739d759aed8 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:45.857168 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8859661a-1c21-411b-8a0e-c739d759aed8 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:45.980600 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-8859661a-1c21-411b-8a0e-c739d759aed8 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lazy-loading 'services' on Instance uuid 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:07:46.123322 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8859661a-1c21-411b-8a0e-c739d759aed8 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490/os-volume_attachments/db011e96-95c8-4d8a-a57c-044227034d08" status: 202 len: 0 microversion: 2.1 time: 0.285876 Jun 03 13:07:46.124225 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 213/420] 10.222.0.58 () {58 vars in 1415 bytes} [Fri Jun 3 13:07:45 2022] DELETE /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490/os-volume_attachments/db011e96-95c8-4d8a-a57c-044227034d08 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:07:47.265471 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=13 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:47.266271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:07:47.270207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6a7d867f-1db2-4ad0-b1f4-5bd3b7a1230f tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:47.270811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6a7d867f-1db2-4ad0-b1f4-5bd3b7a1230f tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:47.278491 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a7d867f-1db2-4ad0-b1f4-5bd3b7a1230f tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:47.278936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a7d867f-1db2-4ad0-b1f4-5bd3b7a1230f tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:47.279695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a7d867f-1db2-4ad0-b1f4-5bd3b7a1230f tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:47.280121 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6a7d867f-1db2-4ad0-b1f4-5bd3b7a1230f tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:47.308293 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6a7d867f-1db2-4ad0-b1f4-5bd3b7a1230f tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:07:47.402572 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6a7d867f-1db2-4ad0-b1f4-5bd3b7a1230f tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 204 len: 0 microversion: 2.1 time: 0.138349 Jun 03 13:07:47.403150 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 208/421] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:07:47 2022] DELETE /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:07:47.411834 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c590bc19-98db-4ef2-8571-bfb9b6676524 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:47.412532 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c590bc19-98db-4ef2-8571-bfb9b6676524 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:47.419314 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c590bc19-98db-4ef2-8571-bfb9b6676524 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:47.419792 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c590bc19-98db-4ef2-8571-bfb9b6676524 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:47.420570 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c590bc19-98db-4ef2-8571-bfb9b6676524 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:47.421038 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c590bc19-98db-4ef2-8571-bfb9b6676524 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:47.568771 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c590bc19-98db-4ef2-8571-bfb9b6676524 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:47.580584 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c590bc19-98db-4ef2-8571-bfb9b6676524 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1512 microversion: 2.1 time: 0.172645 Jun 03 13:07:47.581484 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 214/422] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:47 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:48.604827 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b1304e17-58b2-432e-b784-a57151cd0187 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:48.605969 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b1304e17-58b2-432e-b784-a57151cd0187 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:48.617311 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b1304e17-58b2-432e-b784-a57151cd0187 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:48.617779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b1304e17-58b2-432e-b784-a57151cd0187 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:48.618602 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b1304e17-58b2-432e-b784-a57151cd0187 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:48.619035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b1304e17-58b2-432e-b784-a57151cd0187 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:48.761126 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b1304e17-58b2-432e-b784-a57151cd0187 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:48.769046 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b1304e17-58b2-432e-b784-a57151cd0187 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1512 microversion: 2.1 time: 0.171544 Jun 03 13:07:48.769618 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 209/423] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:48 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:48.990683 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e01a38ba-9100-4c51-80b4-e270e0c86d4c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "275a6971-4e54-4835-8765-b366e8d2388b"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:07:48.992192 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e01a38ba-9100-4c51-80b4-e270e0c86d4c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:49.001953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e01a38ba-9100-4c51-80b4-e270e0c86d4c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:49.002605 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e01a38ba-9100-4c51-80b4-e270e0c86d4c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:49.003851 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e01a38ba-9100-4c51-80b4-e270e0c86d4c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:49.004509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e01a38ba-9100-4c51-80b4-e270e0c86d4c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:49.290868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e01a38ba-9100-4c51-80b4-e270e0c86d4c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "POST /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418921 Jun 03 13:07:49.291586 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 215/424] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:07:48 2022] POST /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:07:49.787665 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9029a5d0-f306-4d7d-bdf3-b5e4a75fb115 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:49.788201 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9029a5d0-f306-4d7d-bdf3-b5e4a75fb115 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:49.795278 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9029a5d0-f306-4d7d-bdf3-b5e4a75fb115 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:49.795541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9029a5d0-f306-4d7d-bdf3-b5e4a75fb115 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:49.796320 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9029a5d0-f306-4d7d-bdf3-b5e4a75fb115 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:49.796804 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9029a5d0-f306-4d7d-bdf3-b5e4a75fb115 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:50.225247 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9029a5d0-f306-4d7d-bdf3-b5e4a75fb115 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ff2e53a17c4052a08ebe104034ab80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b579f36c6162451daa31ad27aa97a083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:50.232990 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9029a5d0-f306-4d7d-bdf3-b5e4a75fb115 tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 200 len: 1512 microversion: 2.1 time: 0.449302 Jun 03 13:07:50.234016 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 210/425] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:49 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 1512 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:07:50.514696 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-fa5a8f0e-50a9-462e-9bb5-4ba6cb46111b req-4d271016-5432-4b4f-ba9f-d6b8c10f32ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490", "name": "network-vif-deleted", "tag": "a0bca9d5-fcf6-4098-923a-a0f922318083"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:07:50.524666 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-fa5a8f0e-50a9-462e-9bb5-4ba6cb46111b req-4d271016-5432-4b4f-ba9f-d6b8c10f32ef service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:50.525209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-fa5a8f0e-50a9-462e-9bb5-4ba6cb46111b req-4d271016-5432-4b4f-ba9f-d6b8c10f32ef service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:50.536232 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-fa5a8f0e-50a9-462e-9bb5-4ba6cb46111b req-4d271016-5432-4b4f-ba9f-d6b8c10f32ef service nova] Creating event network-vif-deleted:a0bca9d5-fcf6-4098-923a-a0f922318083 for instance 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 on hv-cinder-77954 Jun 03 13:07:50.541206 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-fa5a8f0e-50a9-462e-9bb5-4ba6cb46111b req-4d271016-5432-4b4f-ba9f-d6b8c10f32ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092485 Jun 03 13:07:50.541802 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 216/426] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:07:51.254738 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-575c2ab8-9947-4c1e-8dec-c43f605261be tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:51.255686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-575c2ab8-9947-4c1e-8dec-c43f605261be tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] [instance: 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:51.263502 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-575c2ab8-9947-4c1e-8dec-c43f605261be tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:51.263950 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-575c2ab8-9947-4c1e-8dec-c43f605261be tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:51.264749 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-575c2ab8-9947-4c1e-8dec-c43f605261be tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:51.265163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-575c2ab8-9947-4c1e-8dec-c43f605261be tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:51.278825 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-575c2ab8-9947-4c1e-8dec-c43f605261be tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] HTTP exception thrown: Instance 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 could not be found. Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-575c2ab8-9947-4c1e-8dec-c43f605261be tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Request method failure captured: Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 HTTP/1.1 Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgconb-hnGi5T0uwIvjvtQR75chmGsXAxXWiGlGPPsNeXYeXLsxisKxte0zAXs03Un1LzUU749xGwP6d9Vff5RK7Q0O5WqDjH0CsOwg9WWQRUGpP6heR0FPwrteDK5FfIy9_vfls0kCnWLdqx14yaC5tNJyKiLpV5RDxfkZWZUnpbmE Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: b579f36c6162451daa31ad27aa97a083 Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2034862311 Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:07:51.280482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:07:51.281864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b579f36c6162451daa31ad27aa97a083"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b579f36c6162451daa31ad27aa97a083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b579f36c6162451daa31ad27aa97a083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b579f36c6162451daa31ad27aa97a083"}]}] Jun 03 13:07:51.281864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesSnapshotTestJSON-2034862311 Jun 03 13:07:51.281864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: b579f36c6162451daa31ad27aa97a083 Jun 03 13:07:51.281864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2034862311 Jun 03 13:07:51.281864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesSnapshotTestJSON-2034862311-project Jun 03 13:07:51.281864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:07:51.281864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:07:51.281864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 50ff2e53a17c4052a08ebe104034ab80 Jun 03 13:07:51.281864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesSnapshotTestJSON-2034862311-project Jun 03 13:07:51.281864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:07:51.281864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 could not be found. Jun 03 13:07:51.281864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490'} Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 could not be found. Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:07:51.282666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 could not be found. Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 could not be found. Jun 03 13:07:51.284163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:07:51.285579 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-575c2ab8-9947-4c1e-8dec-c43f605261be tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] Returning 404 to user: Instance 6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:07:51.285579 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-575c2ab8-9947-4c1e-8dec-c43f605261be tempest-VolumesSnapshotTestJSON-2034862311 tempest-VolumesSnapshotTestJSON-2034862311-project] 10.222.0.58 "GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490" status: 404 len: 111 microversion: 2.1 time: 0.033623 Jun 03 13:07:51.285579 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 211/427] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:51 2022] GET /compute/v2.1/servers/6eea1ad1-d9e6-4b55-ad3b-917d3bbcd490 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:07:58.964951 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7bc93617-6d50-445a-8464-c4bab9fc704a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:07:58.965979 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7bc93617-6d50-445a-8464-c4bab9fc704a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:58.972846 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bc93617-6d50-445a-8464-c4bab9fc704a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:58.973301 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bc93617-6d50-445a-8464-c4bab9fc704a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:58.974077 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bc93617-6d50-445a-8464-c4bab9fc704a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:58.974549 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bc93617-6d50-445a-8464-c4bab9fc704a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:58.999109 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-7bc93617-6d50-445a-8464-c4bab9fc704a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lazy-loading 'flavor' on Instance uuid a6908a57-1971-4cba-abd3-b6d365aebff0 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:07:59.176915 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7bc93617-6d50-445a-8464-c4bab9fc704a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "POST /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/action" status: 200 len: 32 microversion: 2.1 time: 0.216743 Jun 03 13:07:59.177712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 217/428] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:07:58 2022] POST /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/action => generated 32 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:07:59.187475 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d754784d-ab1e-413c-b2f0-f96a7a965d98 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:07:59.188038 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d754784d-ab1e-413c-b2f0-f96a7a965d98 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:07:59.195525 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d754784d-ab1e-413c-b2f0-f96a7a965d98 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:59.196111 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d754784d-ab1e-413c-b2f0-f96a7a965d98 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:59.196896 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d754784d-ab1e-413c-b2f0-f96a7a965d98 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:07:59.197380 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d754784d-ab1e-413c-b2f0-f96a7a965d98 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:07:59.404501 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d754784d-ab1e-413c-b2f0-f96a7a965d98 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:07:59.413012 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d754784d-ab1e-413c-b2f0-f96a7a965d98 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.229353 Jun 03 13:07:59.413737 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 212/429] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:07:59 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:00.433417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d708217d-ab9a-4563-81e6-e2c4ab32b81a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:00.434140 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d708217d-ab9a-4563-81e6-e2c4ab32b81a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:00.441062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d708217d-ab9a-4563-81e6-e2c4ab32b81a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:00.441516 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d708217d-ab9a-4563-81e6-e2c4ab32b81a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:00.442340 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d708217d-ab9a-4563-81e6-e2c4ab32b81a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:00.442779 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d708217d-ab9a-4563-81e6-e2c4ab32b81a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:00.583499 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d708217d-ab9a-4563-81e6-e2c4ab32b81a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:00.591845 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d708217d-ab9a-4563-81e6-e2c4ab32b81a tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.164656 Jun 03 13:08:00.592450 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 218/430] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:00 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:01.610534 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5da26817-8ecf-468f-85bc-bfb99e365190 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:01.611546 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5da26817-8ecf-468f-85bc-bfb99e365190 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:01.620425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5da26817-8ecf-468f-85bc-bfb99e365190 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:01.621126 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5da26817-8ecf-468f-85bc-bfb99e365190 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:01.622065 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5da26817-8ecf-468f-85bc-bfb99e365190 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:01.622604 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5da26817-8ecf-468f-85bc-bfb99e365190 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:01.804152 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5da26817-8ecf-468f-85bc-bfb99e365190 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:01.814133 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5da26817-8ecf-468f-85bc-bfb99e365190 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.208002 Jun 03 13:08:01.814702 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 213/431] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:01 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:02.835445 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6eebd97d-7192-4e12-8399-eb03065fecd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:02.836025 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6eebd97d-7192-4e12-8399-eb03065fecd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:02.843369 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6eebd97d-7192-4e12-8399-eb03065fecd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:02.843821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6eebd97d-7192-4e12-8399-eb03065fecd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:02.844605 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6eebd97d-7192-4e12-8399-eb03065fecd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:02.845041 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6eebd97d-7192-4e12-8399-eb03065fecd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:02.989136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6eebd97d-7192-4e12-8399-eb03065fecd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:02.997385 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6eebd97d-7192-4e12-8399-eb03065fecd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.167476 Jun 03 13:08:02.997971 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 219/432] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:02 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:04.018600 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8e714f3f-c3f8-4932-97dc-b0c71ede6bd5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:04.019669 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8e714f3f-c3f8-4932-97dc-b0c71ede6bd5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:04.029063 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e714f3f-c3f8-4932-97dc-b0c71ede6bd5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:04.029538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e714f3f-c3f8-4932-97dc-b0c71ede6bd5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:04.030346 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e714f3f-c3f8-4932-97dc-b0c71ede6bd5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:04.030781 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8e714f3f-c3f8-4932-97dc-b0c71ede6bd5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:04.164531 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8e714f3f-c3f8-4932-97dc-b0c71ede6bd5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:04.176913 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8e714f3f-c3f8-4932-97dc-b0c71ede6bd5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.164509 Jun 03 13:08:04.177680 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 214/433] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:04 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:05.196409 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d07728ce-1022-4de3-96b3-82b1eb240707 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:05.196998 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d07728ce-1022-4de3-96b3-82b1eb240707 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:05.206169 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d07728ce-1022-4de3-96b3-82b1eb240707 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:05.206840 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d07728ce-1022-4de3-96b3-82b1eb240707 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:05.207941 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d07728ce-1022-4de3-96b3-82b1eb240707 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:05.208569 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d07728ce-1022-4de3-96b3-82b1eb240707 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:05.352203 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d07728ce-1022-4de3-96b3-82b1eb240707 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:05.361129 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d07728ce-1022-4de3-96b3-82b1eb240707 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.168674 Jun 03 13:08:05.362046 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 220/434] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:05 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:06.382440 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ea85db37-6217-4b58-9b03-7d125d8a7d62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:06.383435 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ea85db37-6217-4b58-9b03-7d125d8a7d62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:06.394688 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea85db37-6217-4b58-9b03-7d125d8a7d62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:06.395438 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea85db37-6217-4b58-9b03-7d125d8a7d62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:06.396710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea85db37-6217-4b58-9b03-7d125d8a7d62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:06.397453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ea85db37-6217-4b58-9b03-7d125d8a7d62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:06.540229 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ea85db37-6217-4b58-9b03-7d125d8a7d62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:06.548761 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ea85db37-6217-4b58-9b03-7d125d8a7d62 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.173169 Jun 03 13:08:06.549328 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 215/435] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:06 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:07.567490 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f653df0b-52ef-4a0a-8923-d28de0f26e80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:07.574832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f653df0b-52ef-4a0a-8923-d28de0f26e80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:07.581545 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f653df0b-52ef-4a0a-8923-d28de0f26e80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:07.582019 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f653df0b-52ef-4a0a-8923-d28de0f26e80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:07.582808 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f653df0b-52ef-4a0a-8923-d28de0f26e80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:07.583245 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f653df0b-52ef-4a0a-8923-d28de0f26e80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:07.718434 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f653df0b-52ef-4a0a-8923-d28de0f26e80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:07.726944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f653df0b-52ef-4a0a-8923-d28de0f26e80 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.163393 Jun 03 13:08:07.727522 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 221/436] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:07 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:08.749092 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-916d1ce7-4ab0-4009-a2a2-3da14ffa91e2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:08.749710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-916d1ce7-4ab0-4009-a2a2-3da14ffa91e2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:08.756746 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-916d1ce7-4ab0-4009-a2a2-3da14ffa91e2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:08.757203 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-916d1ce7-4ab0-4009-a2a2-3da14ffa91e2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:08.757977 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-916d1ce7-4ab0-4009-a2a2-3da14ffa91e2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:08.758451 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-916d1ce7-4ab0-4009-a2a2-3da14ffa91e2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:08.902830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-916d1ce7-4ab0-4009-a2a2-3da14ffa91e2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:08.911432 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-916d1ce7-4ab0-4009-a2a2-3da14ffa91e2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.166509 Jun 03 13:08:08.912014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 216/437] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:08 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:09.928861 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7eaa876c-1c14-475d-8e22-4f2b2ee533c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:09.929485 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7eaa876c-1c14-475d-8e22-4f2b2ee533c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:09.936588 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7eaa876c-1c14-475d-8e22-4f2b2ee533c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:09.937043 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7eaa876c-1c14-475d-8e22-4f2b2ee533c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:09.937823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7eaa876c-1c14-475d-8e22-4f2b2ee533c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:09.938300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7eaa876c-1c14-475d-8e22-4f2b2ee533c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:10.081398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7eaa876c-1c14-475d-8e22-4f2b2ee533c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:10.090003 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7eaa876c-1c14-475d-8e22-4f2b2ee533c2 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.164996 Jun 03 13:08:10.090607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 222/438] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:09 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:11.107265 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a8e7b9d2-c9f8-4373-9f65-64c8eea71c28 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:11.107830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a8e7b9d2-c9f8-4373-9f65-64c8eea71c28 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:11.115339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a8e7b9d2-c9f8-4373-9f65-64c8eea71c28 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:11.115789 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a8e7b9d2-c9f8-4373-9f65-64c8eea71c28 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:11.116566 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a8e7b9d2-c9f8-4373-9f65-64c8eea71c28 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:11.117004 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a8e7b9d2-c9f8-4373-9f65-64c8eea71c28 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:11.256096 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a8e7b9d2-c9f8-4373-9f65-64c8eea71c28 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:11.265387 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a8e7b9d2-c9f8-4373-9f65-64c8eea71c28 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.162120 Jun 03 13:08:11.265965 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 217/439] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:11 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:12.284181 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c7b25a4e-78f2-4d3f-9754-460654832dd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:12.285071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c7b25a4e-78f2-4d3f-9754-460654832dd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:12.292978 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7b25a4e-78f2-4d3f-9754-460654832dd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:12.293433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7b25a4e-78f2-4d3f-9754-460654832dd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:12.294244 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7b25a4e-78f2-4d3f-9754-460654832dd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:12.294670 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7b25a4e-78f2-4d3f-9754-460654832dd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:12.437693 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c7b25a4e-78f2-4d3f-9754-460654832dd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:12.445700 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c7b25a4e-78f2-4d3f-9754-460654832dd6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.166241 Jun 03 13:08:12.446288 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 223/440] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:12 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:13.466193 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dc69f45d-3715-4459-8393-7c29e927c2f5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:13.466875 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dc69f45d-3715-4459-8393-7c29e927c2f5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:13.473851 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dc69f45d-3715-4459-8393-7c29e927c2f5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:13.474292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dc69f45d-3715-4459-8393-7c29e927c2f5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:13.475073 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dc69f45d-3715-4459-8393-7c29e927c2f5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:13.475809 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dc69f45d-3715-4459-8393-7c29e927c2f5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:13.634752 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dc69f45d-3715-4459-8393-7c29e927c2f5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:13.643916 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dc69f45d-3715-4459-8393-7c29e927c2f5 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.183203 Jun 03 13:08:13.644524 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 218/441] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:13 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:14.660814 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-75403854-1ed7-4e44-a277-074f94db2bc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:14.661448 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-75403854-1ed7-4e44-a277-074f94db2bc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:14.668166 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75403854-1ed7-4e44-a277-074f94db2bc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:14.669231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75403854-1ed7-4e44-a277-074f94db2bc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:14.670020 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75403854-1ed7-4e44-a277-074f94db2bc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:14.670484 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75403854-1ed7-4e44-a277-074f94db2bc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:14.822438 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-75403854-1ed7-4e44-a277-074f94db2bc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:14.831546 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-75403854-1ed7-4e44-a277-074f94db2bc7 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.174654 Jun 03 13:08:14.832200 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 224/442] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:14 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:15.850666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a71de0ce-582b-4eb0-bbe6-abadcfc51ad9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:15.851287 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a71de0ce-582b-4eb0-bbe6-abadcfc51ad9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:15.858853 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a71de0ce-582b-4eb0-bbe6-abadcfc51ad9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:15.859338 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a71de0ce-582b-4eb0-bbe6-abadcfc51ad9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:15.860113 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a71de0ce-582b-4eb0-bbe6-abadcfc51ad9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:15.860550 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a71de0ce-582b-4eb0-bbe6-abadcfc51ad9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:16.010039 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a71de0ce-582b-4eb0-bbe6-abadcfc51ad9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:16.019153 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a71de0ce-582b-4eb0-bbe6-abadcfc51ad9 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.172468 Jun 03 13:08:16.019858 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 219/443] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:15 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:17.038251 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-231dc727-6802-491e-88a1-e9c0a1969387 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:17.038959 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-231dc727-6802-491e-88a1-e9c0a1969387 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:17.041952 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=25 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:17.047782 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-231dc727-6802-491e-88a1-e9c0a1969387 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:17.048565 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-231dc727-6802-491e-88a1-e9c0a1969387 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:17.049440 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-231dc727-6802-491e-88a1-e9c0a1969387 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:17.049961 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-231dc727-6802-491e-88a1-e9c0a1969387 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:17.054751 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:17.225434 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-231dc727-6802-491e-88a1-e9c0a1969387 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:17.234538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-231dc727-6802-491e-88a1-e9c0a1969387 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.200786 Jun 03 13:08:17.235130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 225/444] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:17 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:18.252476 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6436ac83-24aa-4bbc-a4c5-b300d37897c3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:18.253063 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6436ac83-24aa-4bbc-a4c5-b300d37897c3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:18.255557 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:18.261085 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6436ac83-24aa-4bbc-a4c5-b300d37897c3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:18.261563 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6436ac83-24aa-4bbc-a4c5-b300d37897c3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:18.262376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6436ac83-24aa-4bbc-a4c5-b300d37897c3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:18.263146 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6436ac83-24aa-4bbc-a4c5-b300d37897c3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:18.268135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:18.399370 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6436ac83-24aa-4bbc-a4c5-b300d37897c3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:18.407784 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6436ac83-24aa-4bbc-a4c5-b300d37897c3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1734 microversion: 2.1 time: 0.159585 Jun 03 13:08:18.408320 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 220/445] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:18 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:19.425358 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9967a66a-e4c1-46da-bec6-36e6a3a64228 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:19.426054 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9967a66a-e4c1-46da-bec6-36e6a3a64228 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:19.432962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9967a66a-e4c1-46da-bec6-36e6a3a64228 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:19.433487 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9967a66a-e4c1-46da-bec6-36e6a3a64228 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:19.434350 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9967a66a-e4c1-46da-bec6-36e6a3a64228 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:19.434813 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9967a66a-e4c1-46da-bec6-36e6a3a64228 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:19.584512 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9967a66a-e4c1-46da-bec6-36e6a3a64228 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:19.592657 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9967a66a-e4c1-46da-bec6-36e6a3a64228 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1714 microversion: 2.1 time: 0.171487 Jun 03 13:08:19.593403 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 226/446] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:19 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1714 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:19.719973 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d3f5e2a9-589e-4bfc-9bb6-fe7d99198ef8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:19.720511 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d3f5e2a9-589e-4bfc-9bb6-fe7d99198ef8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:19.727064 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3f5e2a9-589e-4bfc-9bb6-fe7d99198ef8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:19.727521 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3f5e2a9-589e-4bfc-9bb6-fe7d99198ef8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:19.728293 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3f5e2a9-589e-4bfc-9bb6-fe7d99198ef8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:19.728733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3f5e2a9-589e-4bfc-9bb6-fe7d99198ef8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:19.810950 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-d3f5e2a9-589e-4bfc-9bb6-fe7d99198ef8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] HTTP exception thrown: Cannot 'detach_volume' instance a6908a57-1971-4cba-abd3-b6d365aebff0 while it is in vm_state rescued Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d3f5e2a9-589e-4bfc-9bb6-fe7d99198ef8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Request method failure captured: Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: DELETE /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-volume_attachments/275a6971-4e54-4835-8765-b366e8d2388b HTTP/1.1 Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgZb6OIAoFXauJTIaqiZtgkaDduvm40Tmnjoq76MT68LNhb3WKogFBe-eGYSp6zeb8cQNqB8O0IkSk2-MR9STml5Hwl6q8-MoxwD30LLRKESM7goJVvYLGOEIN6xysNErIWQyMbX0Xw6HJDjU3-WmLkhh9NSHZX5VfSX6Mgt9tOPOxQ Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 45170704be9845929be13eb3a96eeb07 Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:08:19.812637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:08:19.814168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45170704be9845929be13eb3a96eeb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45170704be9845929be13eb3a96eeb07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45170704be9845929be13eb3a96eeb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45170704be9845929be13eb3a96eeb07"}]}] Jun 03 13:08:19.814168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:08:19.814168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 45170704be9845929be13eb3a96eeb07 Jun 03 13:08:19.814168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:08:19.814168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-ServerRescueNegativeTestJSON-972257074-project Jun 03 13:08:19.814168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:08:19.814168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:08:19.814168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 010c4d5ba6b847b79d3127787db2ddd6 Jun 03 13:08:19.814168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-972257074-project Jun 03 13:08:19.814168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:08:19.814168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Cannot 'detach_volume' instance a6908a57-1971-4cba-abd3-b6d365aebff0 while it is in vm_state rescued Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'server_id': 'a6908a57-1971-4cba-abd3-b6d365aebff0', 'id': '275a6971-4e54-4835-8765-b366e8d2388b'} Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a6908a57-1971-4cba-abd3-b6d365aebff0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:08:19.814927 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a6908a57-1971-4cba-abd3-b6d365aebff0 while it is in vm_state rescued Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a6908a57-1971-4cba-abd3-b6d365aebff0 while it is in vm_state rescued Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:08:19.816376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d3f5e2a9-589e-4bfc-9bb6-fe7d99198ef8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Returning 409 to user: Cannot 'detach_volume' instance a6908a57-1971-4cba-abd3-b6d365aebff0 while it is in vm_state rescued {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:08:19.817516 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d3f5e2a9-589e-4bfc-9bb6-fe7d99198ef8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-volume_attachments/275a6971-4e54-4835-8765-b366e8d2388b" status: 409 len: 152 microversion: 2.1 time: 0.098430 Jun 03 13:08:19.817516 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 221/447] 10.222.0.58 () {58 vars in 1415 bytes} [Fri Jun 3 13:08:19 2022] DELETE /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-volume_attachments/275a6971-4e54-4835-8765-b366e8d2388b => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 13:08:19.823121 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b798640d-d5e5-4643-981b-58b14698c2e6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:08:19.823653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b798640d-d5e5-4643-981b-58b14698c2e6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:19.830231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b798640d-d5e5-4643-981b-58b14698c2e6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:19.830689 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b798640d-d5e5-4643-981b-58b14698c2e6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:19.831474 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b798640d-d5e5-4643-981b-58b14698c2e6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:19.831904 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b798640d-d5e5-4643-981b-58b14698c2e6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:19.902191 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b798640d-d5e5-4643-981b-58b14698c2e6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "POST /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/action" status: 202 len: 0 microversion: 2.1 time: 0.082871 Jun 03 13:08:19.906159 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 227/448] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:08:19 2022] POST /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:08:19.912203 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-49ad1b9a-34cc-486b-85fd-fcdc097837af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:19.913178 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-49ad1b9a-34cc-486b-85fd-fcdc097837af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:19.920175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49ad1b9a-34cc-486b-85fd-fcdc097837af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:19.920717 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49ad1b9a-34cc-486b-85fd-fcdc097837af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:19.921931 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49ad1b9a-34cc-486b-85fd-fcdc097837af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:19.922756 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-49ad1b9a-34cc-486b-85fd-fcdc097837af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:20.147001 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-49ad1b9a-34cc-486b-85fd-fcdc097837af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:20.155709 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-49ad1b9a-34cc-486b-85fd-fcdc097837af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1722 microversion: 2.1 time: 0.247965 Jun 03 13:08:20.156631 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 222/449] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:19 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:21.173830 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6f8fca74-ecc0-4939-b169-1966b5afd6be tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:21.174554 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6f8fca74-ecc0-4939-b169-1966b5afd6be tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:21.181846 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f8fca74-ecc0-4939-b169-1966b5afd6be tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:21.182347 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f8fca74-ecc0-4939-b169-1966b5afd6be tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:21.183134 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f8fca74-ecc0-4939-b169-1966b5afd6be tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:21.183578 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6f8fca74-ecc0-4939-b169-1966b5afd6be tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:21.326292 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6f8fca74-ecc0-4939-b169-1966b5afd6be tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:21.335813 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6f8fca74-ecc0-4939-b169-1966b5afd6be tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1722 microversion: 2.1 time: 0.166482 Jun 03 13:08:21.336386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 228/450] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:21 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:22.099969 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:08:22.100924 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Fri Jun 3 13:08:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:08:22.354066 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a25b10c3-2030-4b82-9d0c-2cf82220a773 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:22.354711 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a25b10c3-2030-4b82-9d0c-2cf82220a773 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:22.362546 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a25b10c3-2030-4b82-9d0c-2cf82220a773 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:22.362987 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a25b10c3-2030-4b82-9d0c-2cf82220a773 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:22.363760 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a25b10c3-2030-4b82-9d0c-2cf82220a773 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:22.364227 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a25b10c3-2030-4b82-9d0c-2cf82220a773 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:22.496754 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a25b10c3-2030-4b82-9d0c-2cf82220a773 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:22.505225 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a25b10c3-2030-4b82-9d0c-2cf82220a773 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1722 microversion: 2.1 time: 0.155465 Jun 03 13:08:22.505801 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 223/451] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:22 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:23.523213 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b6984c39-2965-4476-9935-9113ca6bed53 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:23.523818 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b6984c39-2965-4476-9935-9113ca6bed53 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:23.531009 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6984c39-2965-4476-9935-9113ca6bed53 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:23.531802 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6984c39-2965-4476-9935-9113ca6bed53 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:23.532308 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6984c39-2965-4476-9935-9113ca6bed53 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:23.532736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b6984c39-2965-4476-9935-9113ca6bed53 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:23.668864 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b6984c39-2965-4476-9935-9113ca6bed53 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:23.678358 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b6984c39-2965-4476-9935-9113ca6bed53 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1722 microversion: 2.1 time: 0.159062 Jun 03 13:08:23.678922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 229/452] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:23 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:24.701161 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a2eece01-60f3-477e-a830-a35ba374b8ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:24.702159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a2eece01-60f3-477e-a830-a35ba374b8ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:24.713989 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2eece01-60f3-477e-a830-a35ba374b8ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:24.714928 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2eece01-60f3-477e-a830-a35ba374b8ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:24.716313 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2eece01-60f3-477e-a830-a35ba374b8ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:24.717049 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a2eece01-60f3-477e-a830-a35ba374b8ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:24.855494 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a2eece01-60f3-477e-a830-a35ba374b8ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:24.864133 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a2eece01-60f3-477e-a830-a35ba374b8ab tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1722 microversion: 2.1 time: 0.169876 Jun 03 13:08:24.864699 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 224/453] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:24 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:25.886138 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-797ec239-0564-4d2b-8736-b683396783f8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:25.886817 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-797ec239-0564-4d2b-8736-b683396783f8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:25.895031 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-797ec239-0564-4d2b-8736-b683396783f8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:25.895484 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-797ec239-0564-4d2b-8736-b683396783f8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:25.896261 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-797ec239-0564-4d2b-8736-b683396783f8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:25.896700 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-797ec239-0564-4d2b-8736-b683396783f8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:26.037608 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-797ec239-0564-4d2b-8736-b683396783f8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:26.050564 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-797ec239-0564-4d2b-8736-b683396783f8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1722 microversion: 2.1 time: 0.168672 Jun 03 13:08:26.051437 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 230/454] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:25 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:27.072315 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ec0286db-741d-46a7-819d-d066fef9ec44 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:27.073260 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ec0286db-741d-46a7-819d-d066fef9ec44 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:27.084377 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec0286db-741d-46a7-819d-d066fef9ec44 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:27.085117 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec0286db-741d-46a7-819d-d066fef9ec44 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:27.086418 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec0286db-741d-46a7-819d-d066fef9ec44 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:27.087131 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec0286db-741d-46a7-819d-d066fef9ec44 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:27.232489 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ec0286db-741d-46a7-819d-d066fef9ec44 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:27.241198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ec0286db-741d-46a7-819d-d066fef9ec44 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1722 microversion: 2.1 time: 0.175452 Jun 03 13:08:27.241772 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 225/455] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:27 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:28.262874 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-be7d40d2-372e-4c76-8bf8-ec4a47df4169 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:28.263828 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-be7d40d2-372e-4c76-8bf8-ec4a47df4169 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:28.275557 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-be7d40d2-372e-4c76-8bf8-ec4a47df4169 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:28.276303 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-be7d40d2-372e-4c76-8bf8-ec4a47df4169 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:28.277586 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-be7d40d2-372e-4c76-8bf8-ec4a47df4169 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:28.278361 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-be7d40d2-372e-4c76-8bf8-ec4a47df4169 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:28.407746 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-be7d40d2-372e-4c76-8bf8-ec4a47df4169 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:28.416525 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-be7d40d2-372e-4c76-8bf8-ec4a47df4169 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1722 microversion: 2.1 time: 0.160261 Jun 03 13:08:28.417111 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 231/456] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:28 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:29.436140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-90f9e090-6192-4287-b826-b3174b800558 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:29.436888 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-90f9e090-6192-4287-b826-b3174b800558 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:29.445758 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90f9e090-6192-4287-b826-b3174b800558 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:29.446371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90f9e090-6192-4287-b826-b3174b800558 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:29.447333 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90f9e090-6192-4287-b826-b3174b800558 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:29.447877 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90f9e090-6192-4287-b826-b3174b800558 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:29.604292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-90f9e090-6192-4287-b826-b3174b800558 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:29.613084 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-90f9e090-6192-4287-b826-b3174b800558 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1722 microversion: 2.1 time: 0.181878 Jun 03 13:08:29.613666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 226/457] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:29 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:30.631127 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2321f533-bc7f-4fe8-bf73-c66d802b10a6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:30.631766 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2321f533-bc7f-4fe8-bf73-c66d802b10a6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:30.638820 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2321f533-bc7f-4fe8-bf73-c66d802b10a6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:30.639188 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2321f533-bc7f-4fe8-bf73-c66d802b10a6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:30.639975 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2321f533-bc7f-4fe8-bf73-c66d802b10a6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:30.640486 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2321f533-bc7f-4fe8-bf73-c66d802b10a6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:30.789961 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2321f533-bc7f-4fe8-bf73-c66d802b10a6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:08:30.797997 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2321f533-bc7f-4fe8-bf73-c66d802b10a6 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1728 microversion: 2.1 time: 0.170930 Jun 03 13:08:30.798673 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 232/458] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:08:30 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:08:30.815697 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e3a2d94d-c3f8-4ca4-84cb-c84cd2965006 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:08:30.816314 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e3a2d94d-c3f8-4ca4-84cb-c84cd2965006 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:08:30.822954 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e3a2d94d-c3f8-4ca4-84cb-c84cd2965006 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:30.823395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e3a2d94d-c3f8-4ca4-84cb-c84cd2965006 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:30.824156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e3a2d94d-c3f8-4ca4-84cb-c84cd2965006 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:30.824583 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e3a2d94d-c3f8-4ca4-84cb-c84cd2965006 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:30.927165 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e3a2d94d-c3f8-4ca4-84cb-c84cd2965006 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115045 Jun 03 13:08:30.927769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 227/459] 10.222.0.58 () {58 vars in 1274 bytes} [Fri Jun 3 13:08:30 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:08:31.952547 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-7f618e04-2352-4079-a635-ca83f4cfcd1c req-b95429e1-238f-4f4f-a17b-f85afdd09954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6908a57-1971-4cba-abd3-b6d365aebff0", "tag": "7485bbe7-40a4-4a93-bae4-e9f18264d13a"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:08:31.960712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-7f618e04-2352-4079-a635-ca83f4cfcd1c req-b95429e1-238f-4f4f-a17b-f85afdd09954 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:31.961218 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-7f618e04-2352-4079-a635-ca83f4cfcd1c req-b95429e1-238f-4f4f-a17b-f85afdd09954 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:31.971894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-7f618e04-2352-4079-a635-ca83f4cfcd1c req-b95429e1-238f-4f4f-a17b-f85afdd09954 service nova] Creating event network-changed:7485bbe7-40a4-4a93-bae4-e9f18264d13a for instance a6908a57-1971-4cba-abd3-b6d365aebff0 on hv-cinder-77954 Jun 03 13:08:31.977195 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-7f618e04-2352-4079-a635-ca83f4cfcd1c req-b95429e1-238f-4f4f-a17b-f85afdd09954 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151257 Jun 03 13:08:31.977805 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 233/460] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:08:33.999968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-1a5170a3-13d2-4f44-8c76-65a8be6eccc9 req-cf690c50-c8cc-4ff8-9184-7a52a54aecab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6908a57-1971-4cba-abd3-b6d365aebff0", "tag": "7485bbe7-40a4-4a93-bae4-e9f18264d13a"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:08:34.010819 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-1a5170a3-13d2-4f44-8c76-65a8be6eccc9 req-cf690c50-c8cc-4ff8-9184-7a52a54aecab service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:08:34.011264 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-1a5170a3-13d2-4f44-8c76-65a8be6eccc9 req-cf690c50-c8cc-4ff8-9184-7a52a54aecab service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:08:34.023101 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-1a5170a3-13d2-4f44-8c76-65a8be6eccc9 req-cf690c50-c8cc-4ff8-9184-7a52a54aecab service nova] Creating event network-changed:7485bbe7-40a4-4a93-bae4-e9f18264d13a for instance a6908a57-1971-4cba-abd3-b6d365aebff0 on hv-cinder-77954 Jun 03 13:08:34.028143 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-1a5170a3-13d2-4f44-8c76-65a8be6eccc9 req-cf690c50-c8cc-4ff8-9184-7a52a54aecab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035472 Jun 03 13:08:34.028743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 228/461] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:08:51.419239 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=17 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:51.419993 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:08:51.603954 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e3456216-1357-489f-88c0-7dee7d6ee07d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Action: 'create', calling method: .version_select at 0x7fc5a43b9670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2140023348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVkdEgHCvn4E/AHAY1XZfEH5dkppaBwjAtuJkLu0NxRXp22UszQzX/xyZ+CPiJmBjx/XjlGrNrMmNW3wmeGbXt8is2IFjm7G1BDmr5AIoETdn6SKOtwwzzSZ9wUS7U6mg=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:08:51.618832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-e3456216-1357-489f-88c0-7dee7d6ee07d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Getting quotas for project 2fd9de1783e54cafadd25ecc97876288. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:08:51.623056 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-e3456216-1357-489f-88c0-7dee7d6ee07d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Getting quotas for user 62f5e92899b84d5594a34643b662d233 and project 2fd9de1783e54cafadd25ecc97876288. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:08:51.636293 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e3456216-1357-489f-88c0-7dee7d6ee07d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [72fdfa76-4aaa-4b44-aa1e-a7d82db2abf7] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 03 13:08:52.648088 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [None req-e3456216-1357-489f-88c0-7dee7d6ee07d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [72fdfa76-4aaa-4b44-aa1e-a7d82db2abf7] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 58386. Jun 03 13:08:52.672429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e3456216-1357-489f-88c0-7dee7d6ee07d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.254879 Jun 03 13:08:52.673058 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 234/462] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Jun 3 13:08:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:00.036185 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=17 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:00.037195 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=47 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:00.310639 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-32f43246-bf6c-49ea-b038-b5bfb0890a59 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:00.311241 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-32f43246-bf6c-49ea-b038-b5bfb0890a59 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:00.318470 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-32f43246-bf6c-49ea-b038-b5bfb0890a59 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:00.318933 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-32f43246-bf6c-49ea-b038-b5bfb0890a59 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:00.319699 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-32f43246-bf6c-49ea-b038-b5bfb0890a59 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:00.320129 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-32f43246-bf6c-49ea-b038-b5bfb0890a59 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:00.346100 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-32f43246-bf6c-49ea-b038-b5bfb0890a59 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f/ips" status: 200 len: 148 microversion: 2.1 time: 0.315062 Jun 03 13:09:00.346685 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 229/463] 10.222.0.58 () {58 vars in 1247 bytes} [Fri Jun 3 13:09:00 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f/ips => generated 148 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:00.357835 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fcd036eb-792a-4c74-81bb-a83c525b5d96 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4c9fda0-7b2d-48f2-90bf-9ef12ddea229"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:00.359042 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fcd036eb-792a-4c74-81bb-a83c525b5d96 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:00.366339 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fcd036eb-792a-4c74-81bb-a83c525b5d96 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:00.366781 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fcd036eb-792a-4c74-81bb-a83c525b5d96 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:00.367542 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fcd036eb-792a-4c74-81bb-a83c525b5d96 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:00.367973 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fcd036eb-792a-4c74-81bb-a83c525b5d96 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:00.475868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-fcd036eb-792a-4c74-81bb-a83c525b5d96 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Invalid volume: volume c4c9fda0-7b2d-48f2-90bf-9ef12ddea229 is already attached to instances: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fcd036eb-792a-4c74-81bb-a83c525b5d96 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: POST /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f/os-volume_attachments HTTP/1.1 Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 74 Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:09:00.478087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:09:00.480164 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:09:00.480164 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:09:00.480164 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:09:00.480164 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:09:00.480164 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:09:00.480164 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:09:00.480164 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:09:00.480164 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:09:00.480164 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:09:00.480164 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Jun 03 13:09:00.480164 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {"volumeAttachment": {"volumeId": "c4c9fda0-7b2d-48f2-90bf-9ef12ddea229"}} Jun 03 13:09:00.480164 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Invalid volume: volume c4c9fda0-7b2d-48f2-90bf-9ef12ddea229 is already attached to instances: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'server_id': '27fb1319-f284-49dc-a3eb-2574997aec2f', 'body': {'volumeAttachment': {'volumeId': 'c4c9fda0-7b2d-48f2-90bf-9ef12ddea229'}}} Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c4c9fda0-7b2d-48f2-90bf-9ef12ddea229 is already attached to instances: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:00.481417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c4c9fda0-7b2d-48f2-90bf-9ef12ddea229 is already attached to instances: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:00.483488 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:00.485672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:00.485672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:09:00.485672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:09:00.485672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c4c9fda0-7b2d-48f2-90bf-9ef12ddea229 is already attached to instances: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c Jun 03 13:09:00.485672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:00.485672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fcd036eb-792a-4c74-81bb-a83c525b5d96 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 400 to user: Invalid volume: volume c4c9fda0-7b2d-48f2-90bf-9ef12ddea229 is already attached to instances: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:09:00.485672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fcd036eb-792a-4c74-81bb-a83c525b5d96 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.126498 Jun 03 13:09:00.485672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 235/464] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:09:00 2022] POST /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f/os-volume_attachments => generated 174 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:09:00.490392 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b34067b1-192d-458a-85a8-01356d27a3d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:00.490825 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b34067b1-192d-458a-85a8-01356d27a3d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:00.497816 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b34067b1-192d-458a-85a8-01356d27a3d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:00.498296 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b34067b1-192d-458a-85a8-01356d27a3d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:00.499075 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b34067b1-192d-458a-85a8-01356d27a3d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:00.499509 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b34067b1-192d-458a-85a8-01356d27a3d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:00.524300 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b34067b1-192d-458a-85a8-01356d27a3d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:09:00.616238 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-38fab8fa-d534-400d-86da-7f23c5c46469 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2013920526"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:00.617121 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-38fab8fa-d534-400d-86da-7f23c5c46469 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:00.625291 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-38fab8fa-d534-400d-86da-7f23c5c46469 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:00.625729 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-38fab8fa-d534-400d-86da-7f23c5c46469 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:00.626571 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-38fab8fa-d534-400d-86da-7f23c5c46469 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:00.626994 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-38fab8fa-d534-400d-86da-7f23c5c46469 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:00.629853 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b34067b1-192d-458a-85a8-01356d27a3d8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 204 len: 0 microversion: 2.1 time: 0.143702 Jun 03 13:09:00.630788 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 230/465] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:09:00 2022] DELETE /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:09:00.639248 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0fd24dd7-2a7f-41aa-bd34-f4b7d736f6c8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:00.639946 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0fd24dd7-2a7f-41aa-bd34-f4b7d736f6c8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:00.645904 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0fd24dd7-2a7f-41aa-bd34-f4b7d736f6c8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:00.646385 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0fd24dd7-2a7f-41aa-bd34-f4b7d736f6c8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:00.647159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0fd24dd7-2a7f-41aa-bd34-f4b7d736f6c8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:00.647589 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0fd24dd7-2a7f-41aa-bd34-f4b7d736f6c8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:00.814182 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.network.security_group_api [None req-38fab8fa-d534-400d-86da-7f23c5c46469 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Removing security group 96bd2c6f-d291-49bc-8b05-b2f0c07c171f from port 5eb94fdb-2f92-4409-b6e6-5181bab08551 Jun 03 13:09:00.870932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0fd24dd7-2a7f-41aa-bd34-f4b7d736f6c8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:00.879027 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0fd24dd7-2a7f-41aa-bd34-f4b7d736f6c8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1680 microversion: 2.1 time: 0.244050 Jun 03 13:09:00.879607 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 231/466] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:00 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1680 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:09:01.236528 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-38fab8fa-d534-400d-86da-7f23c5c46469 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "POST /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/action" status: 202 len: 0 microversion: 2.1 time: 0.742656 Jun 03 13:09:01.237159 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 236/467] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:09:00 2022] POST /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/action => generated 0 bytes in 744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:09:01.257401 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-98c6ca0a-2d84-4bfe-8fb5-c30fad7daf1f req-99157305-4959-4f27-b705-5a00361eabb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0302f410-973f-4fde-b006-425696dadb3f", "tag": "5eb94fdb-2f92-4409-b6e6-5181bab08551"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:01.275985 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-98c6ca0a-2d84-4bfe-8fb5-c30fad7daf1f req-99157305-4959-4f27-b705-5a00361eabb5 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:01.277946 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-98c6ca0a-2d84-4bfe-8fb5-c30fad7daf1f req-99157305-4959-4f27-b705-5a00361eabb5 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:01.302944 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-98c6ca0a-2d84-4bfe-8fb5-c30fad7daf1f req-99157305-4959-4f27-b705-5a00361eabb5 service nova] Creating event network-changed:5eb94fdb-2f92-4409-b6e6-5181bab08551 for instance 0302f410-973f-4fde-b006-425696dadb3f on hv-cinder-77954 Jun 03 13:09:01.315137 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-98c6ca0a-2d84-4bfe-8fb5-c30fad7daf1f req-99157305-4959-4f27-b705-5a00361eabb5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062351 Jun 03 13:09:01.319476 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 232/468] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:09:01.895985 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:01.900759 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-aa0336ee-69c9-4625-9266-a950dcd6e790 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:01.901143 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-aa0336ee-69c9-4625-9266-a950dcd6e790 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:01.908346 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aa0336ee-69c9-4625-9266-a950dcd6e790 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:01.908863 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aa0336ee-69c9-4625-9266-a950dcd6e790 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:01.909744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aa0336ee-69c9-4625-9266-a950dcd6e790 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:01.910283 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aa0336ee-69c9-4625-9266-a950dcd6e790 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:02.231982 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-aa0336ee-69c9-4625-9266-a950dcd6e790 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:02.241620 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-aa0336ee-69c9-4625-9266-a950dcd6e790 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1680 microversion: 2.1 time: 0.346974 Jun 03 13:09:02.242222 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 237/469] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:01 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1680 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:02.986498 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c414d08b-b39f-4221-921d-85dafee1844a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:02.988233 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c414d08b-b39f-4221-921d-85dafee1844a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:02.995002 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c414d08b-b39f-4221-921d-85dafee1844a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:02.995729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c414d08b-b39f-4221-921d-85dafee1844a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:02.996689 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c414d08b-b39f-4221-921d-85dafee1844a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:02.997280 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c414d08b-b39f-4221-921d-85dafee1844a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:03.109663 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-c414d08b-b39f-4221-921d-85dafee1844a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lazy-loading 'services' on Instance uuid 0302f410-973f-4fde-b006-425696dadb3f {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:09:03.214446 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c414d08b-b39f-4221-921d-85dafee1844a tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments/8d094580-91c3-4ffc-91a7-f7daafc0fd9f" status: 202 len: 0 microversion: 2.1 time: 0.233238 Jun 03 13:09:03.215769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 233/470] 10.222.0.58 () {58 vars in 1415 bytes} [Fri Jun 3 13:09:02 2022] DELETE /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments/8d094580-91c3-4ffc-91a7-f7daafc0fd9f => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:09:03.225237 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8a44776c-e4c7-4b00-af80-3c000a80db1f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:03.226503 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8a44776c-e4c7-4b00-af80-3c000a80db1f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:03.238425 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a44776c-e4c7-4b00-af80-3c000a80db1f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:03.238896 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a44776c-e4c7-4b00-af80-3c000a80db1f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:03.239916 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a44776c-e4c7-4b00-af80-3c000a80db1f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:03.241646 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a44776c-e4c7-4b00-af80-3c000a80db1f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:03.261410 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-38574cff-f1b7-4406-b219-614f9cdc1343 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:03.262356 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-38574cff-f1b7-4406-b219-614f9cdc1343 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:03.292830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38574cff-f1b7-4406-b219-614f9cdc1343 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:03.293603 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38574cff-f1b7-4406-b219-614f9cdc1343 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:03.294716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38574cff-f1b7-4406-b219-614f9cdc1343 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:03.296823 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38574cff-f1b7-4406-b219-614f9cdc1343 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:03.326219 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8a44776c-e4c7-4b00-af80-3c000a80db1f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105068 Jun 03 13:09:03.330755 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 238/471] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:09:03 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:03.343405 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-f6b51ef9-658e-4ccb-9dc5-38c8f8e5f91d req-4f0b1ddd-9232-426d-96a3-4d4bf71bf9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0302f410-973f-4fde-b006-425696dadb3f", "tag": "5eb94fdb-2f92-4409-b6e6-5181bab08551"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:03.364679 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-f6b51ef9-658e-4ccb-9dc5-38c8f8e5f91d req-4f0b1ddd-9232-426d-96a3-4d4bf71bf9aa service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:03.365420 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-f6b51ef9-658e-4ccb-9dc5-38c8f8e5f91d req-4f0b1ddd-9232-426d-96a3-4d4bf71bf9aa service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:03.392245 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-f6b51ef9-658e-4ccb-9dc5-38c8f8e5f91d req-4f0b1ddd-9232-426d-96a3-4d4bf71bf9aa service nova] Creating event network-changed:5eb94fdb-2f92-4409-b6e6-5181bab08551 for instance 0302f410-973f-4fde-b006-425696dadb3f on hv-cinder-77954 Jun 03 13:09:03.411651 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-f6b51ef9-658e-4ccb-9dc5-38c8f8e5f91d req-4f0b1ddd-9232-426d-96a3-4d4bf71bf9aa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079102 Jun 03 13:09:03.413169 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 239/472] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:03.515239 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-38574cff-f1b7-4406-b219-614f9cdc1343 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:03.526888 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-38574cff-f1b7-4406-b219-614f9cdc1343 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1680 microversion: 2.1 time: 0.271778 Jun 03 13:09:03.527570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 234/473] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:03 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1680 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:09:04.261139 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-2e8386b3-3250-47d2-b788-6b6aebaf40d7 req-a8884fd7-d9bf-4e2e-ba44-e3899eb94d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fb1319-f284-49dc-a3eb-2574997aec2f", "name": "network-vif-deleted", "tag": "7d7e272d-3c3e-4fa0-8fe6-be6388ec93cb"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:04.283859 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-2e8386b3-3250-47d2-b788-6b6aebaf40d7 req-a8884fd7-d9bf-4e2e-ba44-e3899eb94d51 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:04.285027 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-2e8386b3-3250-47d2-b788-6b6aebaf40d7 req-a8884fd7-d9bf-4e2e-ba44-e3899eb94d51 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:04.306347 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-2e8386b3-3250-47d2-b788-6b6aebaf40d7 req-a8884fd7-d9bf-4e2e-ba44-e3899eb94d51 service nova] Creating event network-vif-deleted:7d7e272d-3c3e-4fa0-8fe6-be6388ec93cb for instance 27fb1319-f284-49dc-a3eb-2574997aec2f on hv-cinder-77954 Jun 03 13:09:04.321190 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-2e8386b3-3250-47d2-b788-6b6aebaf40d7 req-a8884fd7-d9bf-4e2e-ba44-e3899eb94d51 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064438 Jun 03 13:09:04.322404 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 240/474] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:09:04.338300 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-048bf107-effb-41cc-ad15-fa607266562b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:04.339697 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-048bf107-effb-41cc-ad15-fa607266562b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:04.363515 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-048bf107-effb-41cc-ad15-fa607266562b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:04.363973 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-048bf107-effb-41cc-ad15-fa607266562b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:04.370366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-048bf107-effb-41cc-ad15-fa607266562b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:04.370834 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-048bf107-effb-41cc-ad15-fa607266562b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:04.462984 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-048bf107-effb-41cc-ad15-fa607266562b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.128496 Jun 03 13:09:04.478994 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 235/475] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:09:04 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:04.552783 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-224c8903-118e-4a3d-9555-c84be8e8d7ba tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:04.553581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-224c8903-118e-4a3d-9555-c84be8e8d7ba tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:04.563655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-224c8903-118e-4a3d-9555-c84be8e8d7ba tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:04.564229 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-224c8903-118e-4a3d-9555-c84be8e8d7ba tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:04.565281 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-224c8903-118e-4a3d-9555-c84be8e8d7ba tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:04.566053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-224c8903-118e-4a3d-9555-c84be8e8d7ba tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:04.625726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-224c8903-118e-4a3d-9555-c84be8e8d7ba tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:04.626719 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-224c8903-118e-4a3d-9555-c84be8e8d7ba tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:04.627370 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-224c8903-118e-4a3d-9555-c84be8e8d7ba tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lazy-loading 'fault' on Instance uuid 27fb1319-f284-49dc-a3eb-2574997aec2f {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:09:04.675681 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-224c8903-118e-4a3d-9555-c84be8e8d7ba tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:04.684408 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-224c8903-118e-4a3d-9555-c84be8e8d7ba tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 200 len: 1331 microversion: 2.1 time: 0.140427 Jun 03 13:09:04.686667 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 241/476] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:04 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:05.481486 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bec10652-a3ce-4be8-9ce1-aea4d31b8bad tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:05.482965 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bec10652-a3ce-4be8-9ce1-aea4d31b8bad tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:05.490850 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bec10652-a3ce-4be8-9ce1-aea4d31b8bad tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:05.491421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bec10652-a3ce-4be8-9ce1-aea4d31b8bad tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:05.492286 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bec10652-a3ce-4be8-9ce1-aea4d31b8bad tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:05.492985 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bec10652-a3ce-4be8-9ce1-aea4d31b8bad tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:05.524351 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bec10652-a3ce-4be8-9ce1-aea4d31b8bad tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047034 Jun 03 13:09:05.524964 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 236/477] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:09:05 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:09:05.544214 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-75fd50ec-592b-4195-be6e-6c3605f54d2f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:05.544214 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-75fd50ec-592b-4195-be6e-6c3605f54d2f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:05.552016 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75fd50ec-592b-4195-be6e-6c3605f54d2f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:05.553002 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75fd50ec-592b-4195-be6e-6c3605f54d2f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:05.554343 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75fd50ec-592b-4195-be6e-6c3605f54d2f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:05.554855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75fd50ec-592b-4195-be6e-6c3605f54d2f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:05.638153 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-75fd50ec-592b-4195-be6e-6c3605f54d2f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] HTTP exception thrown: Instance 0302f410-973f-4fde-b006-425696dadb3f is not attached to volume 8d094580-91c3-4ffc-91a7-f7daafc0fd9f Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-75fd50ec-592b-4195-be6e-6c3605f54d2f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Request method failure captured: Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments/8d094580-91c3-4ffc-91a7-f7daafc0fd9f HTTP/1.1 Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgaq6Mk_wtQR3Ew8WYVX0IlIE0XpNN-bVQAfqumVGxXJO1Mg2KrymuJcQ3KJ166eMWzYDf5zKq5oW3npDzuoLpmnVLOIKoiClBaoP56ZB5jlXi7hW4HhL4CsC3o3fYkbT75Ty033AcsgQAHCB2tKrnIgkdHC8yg8J2EQPfISnqHqtW0 Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 80d06506691e4947b14192431bed4453 Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-TestMinimumBasicScenario-2082158207 Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:09:05.640581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:09:05.642262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d06506691e4947b14192431bed4453"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d06506691e4947b14192431bed4453"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d06506691e4947b14192431bed4453"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d06506691e4947b14192431bed4453"}]}] Jun 03 13:09:05.642262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-TestMinimumBasicScenario-2082158207 Jun 03 13:09:05.642262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 80d06506691e4947b14192431bed4453 Jun 03 13:09:05.642262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2082158207 Jun 03 13:09:05.642262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-TestMinimumBasicScenario-2082158207-project Jun 03 13:09:05.642262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:09:05.642262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:09:05.642262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 94dbfb6cf680454f883d43796f05c799 Jun 03 13:09:05.642262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-TestMinimumBasicScenario-2082158207-project Jun 03 13:09:05.642262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:09:05.642262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 0302f410-973f-4fde-b006-425696dadb3f is not attached to volume 8d094580-91c3-4ffc-91a7-f7daafc0fd9f Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'server_id': '0302f410-973f-4fde-b006-425696dadb3f', 'id': '8d094580-91c3-4ffc-91a7-f7daafc0fd9f'} Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8d094580-91c3-4ffc-91a7-f7daafc0fd9f. Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:09:05.643015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0302f410-973f-4fde-b006-425696dadb3f is not attached to volume 8d094580-91c3-4ffc-91a7-f7daafc0fd9f Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0302f410-973f-4fde-b006-425696dadb3f is not attached to volume 8d094580-91c3-4ffc-91a7-f7daafc0fd9f Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:05.645953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-75fd50ec-592b-4195-be6e-6c3605f54d2f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Returning 404 to user: Instance 0302f410-973f-4fde-b006-425696dadb3f is not attached to volume 8d094580-91c3-4ffc-91a7-f7daafc0fd9f {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:09:05.649095 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-75fd50ec-592b-4195-be6e-6c3605f54d2f tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments/8d094580-91c3-4ffc-91a7-f7daafc0fd9f" status: 404 len: 154 microversion: 2.1 time: 0.110834 Jun 03 13:09:05.649095 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 242/478] 10.222.0.58 () {58 vars in 1415 bytes} [Fri Jun 3 13:09:05 2022] DELETE /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f/os-volume_attachments/8d094580-91c3-4ffc-91a7-f7daafc0fd9f => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:09:05.704118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c9af7592-de08-412f-bca5-ee3be74f761a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:05.705007 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c9af7592-de08-412f-bca5-ee3be74f761a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:05.712744 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c9af7592-de08-412f-bca5-ee3be74f761a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:05.713801 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c9af7592-de08-412f-bca5-ee3be74f761a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:05.715226 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c9af7592-de08-412f-bca5-ee3be74f761a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:05.717463 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c9af7592-de08-412f-bca5-ee3be74f761a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:05.733078 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-c9af7592-de08-412f-bca5-ee3be74f761a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c9af7592-de08-412f-bca5-ee3be74f761a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f HTTP/1.1 Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:09:05.734893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:09:05.736473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:09:05.736473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:09:05.736473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:09:05.736473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:09:05.736473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:09:05.736473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:09:05.736473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:09:05.736473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:09:05.736473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:09:05.736473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:09:05.736473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:09:05.736473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '27fb1319-f284-49dc-a3eb-2574997aec2f'} Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:09:05.737373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:09:05.739149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:05.740505 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c9af7592-de08-412f-bca5-ee3be74f761a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 404 to user: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:09:05.740505 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c9af7592-de08-412f-bca5-ee3be74f761a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 404 len: 111 microversion: 2.1 time: 0.040118 Jun 03 13:09:05.744751 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 237/479] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:05 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:09:05.749979 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7676a051-beb2-4dd6-8df7-2180fab230d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '.version_select at 0x7fc5a46635e0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:05.781896 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7676a051-beb2-4dd6-8df7-2180fab230d3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1910236072" status: 202 len: 0 microversion: 2.1 time: 0.036003 Jun 03 13:09:05.782522 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 243/480] 10.222.0.58 () {58 vars in 1220 bytes} [Fri Jun 3 13:09:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1910236072 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:09:06.482298 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-14d6e386-a6d6-4aaa-a388-23e53e04743e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:06.483099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-14d6e386-a6d6-4aaa-a388-23e53e04743e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:06.489754 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-14d6e386-a6d6-4aaa-a388-23e53e04743e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:06.490224 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-14d6e386-a6d6-4aaa-a388-23e53e04743e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:06.490971 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-14d6e386-a6d6-4aaa-a388-23e53e04743e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:06.491457 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-14d6e386-a6d6-4aaa-a388-23e53e04743e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:06.575194 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-14d6e386-a6d6-4aaa-a388-23e53e04743e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lazy-loading 'services' on Instance uuid a85c3fde-c3c5-4354-9c7a-2b432bbdf77c {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:09:06.653798 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-14d6e386-a6d6-4aaa-a388-23e53e04743e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-volume_attachments/c4c9fda0-7b2d-48f2-90bf-9ef12ddea229" status: 202 len: 0 microversion: 2.1 time: 0.175647 Jun 03 13:09:06.654713 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 238/481] 10.222.0.58 () {58 vars in 1415 bytes} [Fri Jun 3 13:09:06 2022] DELETE /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-volume_attachments/c4c9fda0-7b2d-48f2-90bf-9ef12ddea229 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:09:06.663393 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a7a09082-94b8-477c-8462-fd7f5fe30003 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:06.664988 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a7a09082-94b8-477c-8462-fd7f5fe30003 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:06.673373 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7a09082-94b8-477c-8462-fd7f5fe30003 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:06.673902 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7a09082-94b8-477c-8462-fd7f5fe30003 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:06.674730 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7a09082-94b8-477c-8462-fd7f5fe30003 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:06.675416 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a7a09082-94b8-477c-8462-fd7f5fe30003 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:06.710985 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a7a09082-94b8-477c-8462-fd7f5fe30003 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051642 Jun 03 13:09:06.711860 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 244/482] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:09:06 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:06.802633 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-38402bc8-6d39-4411-b952-e637e380fa5b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:06.803215 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-38402bc8-6d39-4411-b952-e637e380fa5b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:06.809635 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38402bc8-6d39-4411-b952-e637e380fa5b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:06.810071 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38402bc8-6d39-4411-b952-e637e380fa5b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:06.811185 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38402bc8-6d39-4411-b952-e637e380fa5b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:06.811613 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-38402bc8-6d39-4411-b952-e637e380fa5b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:06.836335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-38402bc8-6d39-4411-b952-e637e380fa5b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:09:06.917570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-38402bc8-6d39-4411-b952-e637e380fa5b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 204 len: 0 microversion: 2.1 time: 0.118997 Jun 03 13:09:06.918065 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 239/483] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:09:06 2022] DELETE /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:09:06.927833 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6d6ce02b-22e5-4c7d-be27-80c323eed4e6 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:06.928443 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6d6ce02b-22e5-4c7d-be27-80c323eed4e6 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:06.935064 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d6ce02b-22e5-4c7d-be27-80c323eed4e6 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:06.935598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d6ce02b-22e5-4c7d-be27-80c323eed4e6 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:06.936371 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d6ce02b-22e5-4c7d-be27-80c323eed4e6 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:06.936991 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6d6ce02b-22e5-4c7d-be27-80c323eed4e6 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:07.088814 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6d6ce02b-22e5-4c7d-be27-80c323eed4e6 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:07.097583 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6d6ce02b-22e5-4c7d-be27-80c323eed4e6 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1554 microversion: 2.1 time: 0.173594 Jun 03 13:09:07.098442 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 245/484] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:06 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:09:07.729156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-03eaf3c1-198d-49b8-9aeb-36821f4d3877 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:07.730944 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-03eaf3c1-198d-49b8-9aeb-36821f4d3877 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:07.742315 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03eaf3c1-198d-49b8-9aeb-36821f4d3877 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:07.743070 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03eaf3c1-198d-49b8-9aeb-36821f4d3877 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:07.744328 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03eaf3c1-198d-49b8-9aeb-36821f4d3877 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:07.745052 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03eaf3c1-198d-49b8-9aeb-36821f4d3877 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:07.777180 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-03eaf3c1-198d-49b8-9aeb-36821f4d3877 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055387 Jun 03 13:09:07.777735 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 240/485] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:09:07 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:08.120526 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2bfcad00-7af7-4f5a-8ea5-7ee5c41787fe tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:08.121401 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2bfcad00-7af7-4f5a-8ea5-7ee5c41787fe tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:08.133295 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2bfcad00-7af7-4f5a-8ea5-7ee5c41787fe tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:08.134087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2bfcad00-7af7-4f5a-8ea5-7ee5c41787fe tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:08.135405 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2bfcad00-7af7-4f5a-8ea5-7ee5c41787fe tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:08.136118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2bfcad00-7af7-4f5a-8ea5-7ee5c41787fe tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:08.272836 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2bfcad00-7af7-4f5a-8ea5-7ee5c41787fe tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:08.280665 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2bfcad00-7af7-4f5a-8ea5-7ee5c41787fe tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1554 microversion: 2.1 time: 0.167122 Jun 03 13:09:08.281200 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 246/486] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:08 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:08.789524 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-abf0ba2c-54f2-435f-84a3-3ebda2fcda28 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:08.790556 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-abf0ba2c-54f2-435f-84a3-3ebda2fcda28 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:08.797832 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-abf0ba2c-54f2-435f-84a3-3ebda2fcda28 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:08.798377 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-abf0ba2c-54f2-435f-84a3-3ebda2fcda28 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:08.799085 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-abf0ba2c-54f2-435f-84a3-3ebda2fcda28 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:08.799525 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-abf0ba2c-54f2-435f-84a3-3ebda2fcda28 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:08.828467 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-abf0ba2c-54f2-435f-84a3-3ebda2fcda28 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042952 Jun 03 13:09:08.829051 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 241/487] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:09:08 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:09.302226 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4dc53302-c4f0-4ae0-b7d9-692bac11794b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:09.303265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4dc53302-c4f0-4ae0-b7d9-692bac11794b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:09.313420 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4dc53302-c4f0-4ae0-b7d9-692bac11794b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:09.313869 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4dc53302-c4f0-4ae0-b7d9-692bac11794b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:09.314667 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4dc53302-c4f0-4ae0-b7d9-692bac11794b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:09.315099 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4dc53302-c4f0-4ae0-b7d9-692bac11794b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:09.451250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4dc53302-c4f0-4ae0-b7d9-692bac11794b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:09.459060 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4dc53302-c4f0-4ae0-b7d9-692bac11794b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1554 microversion: 2.1 time: 0.163551 Jun 03 13:09:09.459620 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 247/488] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:09 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:09.840593 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-99b707f8-034f-4082-9d4e-fe8c9db14155 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:09.841555 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-99b707f8-034f-4082-9d4e-fe8c9db14155 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:09.848264 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99b707f8-034f-4082-9d4e-fe8c9db14155 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:09.848719 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99b707f8-034f-4082-9d4e-fe8c9db14155 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:09.849497 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99b707f8-034f-4082-9d4e-fe8c9db14155 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:09.849939 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-99b707f8-034f-4082-9d4e-fe8c9db14155 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:09.869172 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:09.883502 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-99b707f8-034f-4082-9d4e-fe8c9db14155 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046920 Jun 03 13:09:09.888837 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 242/489] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:09:09 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:09:09.948928 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8bbcce8b-b9cd-478c-93d5-7b0aa216a092 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:09.949427 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8bbcce8b-b9cd-478c-93d5-7b0aa216a092 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:09.956358 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-e266eefd-54e4-4f37-aaee-68aedeb9cd15 req-8092569c-32b6-4281-b634-b94c4f06aac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0302f410-973f-4fde-b006-425696dadb3f", "name": "network-vif-deleted", "tag": "5eb94fdb-2f92-4409-b6e6-5181bab08551"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:09.961174 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8bbcce8b-b9cd-478c-93d5-7b0aa216a092 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:09.962574 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8bbcce8b-b9cd-478c-93d5-7b0aa216a092 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:09.963533 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8bbcce8b-b9cd-478c-93d5-7b0aa216a092 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:09.963981 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8bbcce8b-b9cd-478c-93d5-7b0aa216a092 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:09.966936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-e266eefd-54e4-4f37-aaee-68aedeb9cd15 req-8092569c-32b6-4281-b634-b94c4f06aac3 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:09.967372 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-e266eefd-54e4-4f37-aaee-68aedeb9cd15 req-8092569c-32b6-4281-b634-b94c4f06aac3 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:09.992044 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8bbcce8b-b9cd-478c-93d5-7b0aa216a092 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:09:09.995555 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-e266eefd-54e4-4f37-aaee-68aedeb9cd15 req-8092569c-32b6-4281-b634-b94c4f06aac3 service nova] Creating event network-vif-deleted:5eb94fdb-2f92-4409-b6e6-5181bab08551 for instance 0302f410-973f-4fde-b006-425696dadb3f on hv-cinder-77954 Jun 03 13:09:10.001003 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-e266eefd-54e4-4f37-aaee-68aedeb9cd15 req-8092569c-32b6-4281-b634-b94c4f06aac3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048402 Jun 03 13:09:10.001841 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 243/490] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:09:10.078065 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8bbcce8b-b9cd-478c-93d5-7b0aa216a092 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 204 len: 0 microversion: 2.1 time: 0.132724 Jun 03 13:09:10.078818 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 248/491] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:09:09 2022] DELETE /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:09:10.087486 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2e4100f9-8307-4bfe-b715-3cd9a45be9a7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:10.088180 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2e4100f9-8307-4bfe-b715-3cd9a45be9a7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:10.094976 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e4100f9-8307-4bfe-b715-3cd9a45be9a7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:10.095425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e4100f9-8307-4bfe-b715-3cd9a45be9a7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:10.096207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e4100f9-8307-4bfe-b715-3cd9a45be9a7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:10.096635 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e4100f9-8307-4bfe-b715-3cd9a45be9a7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:10.241089 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2e4100f9-8307-4bfe-b715-3cd9a45be9a7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:10.251166 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2e4100f9-8307-4bfe-b715-3cd9a45be9a7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1679 microversion: 2.1 time: 0.167719 Jun 03 13:09:10.251724 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 244/492] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:10 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:10.476817 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c63c5e99-1751-4ef4-be50-bf9048cef72d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:10.477389 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c63c5e99-1751-4ef4-be50-bf9048cef72d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:10.485242 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c63c5e99-1751-4ef4-be50-bf9048cef72d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:10.485617 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c63c5e99-1751-4ef4-be50-bf9048cef72d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:10.486422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c63c5e99-1751-4ef4-be50-bf9048cef72d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:10.486857 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c63c5e99-1751-4ef4-be50-bf9048cef72d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:10.520619 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c63c5e99-1751-4ef4-be50-bf9048cef72d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:10.521034 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c63c5e99-1751-4ef4-be50-bf9048cef72d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:10.521486 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-c63c5e99-1751-4ef4-be50-bf9048cef72d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lazy-loading 'fault' on Instance uuid 0302f410-973f-4fde-b006-425696dadb3f {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:09:10.564249 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c63c5e99-1751-4ef4-be50-bf9048cef72d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94dbfb6cf680454f883d43796f05c799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d06506691e4947b14192431bed4453', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:10.572249 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c63c5e99-1751-4ef4-be50-bf9048cef72d tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 200 len: 1348 microversion: 2.1 time: 0.099884 Jun 03 13:09:10.572808 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 249/493] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:10 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:11.273044 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8a96cf90-c01a-4abb-bdcd-09e87104070a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:11.274011 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8a96cf90-c01a-4abb-bdcd-09e87104070a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:11.285221 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a96cf90-c01a-4abb-bdcd-09e87104070a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:11.285956 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a96cf90-c01a-4abb-bdcd-09e87104070a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:11.287313 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a96cf90-c01a-4abb-bdcd-09e87104070a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:11.288023 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8a96cf90-c01a-4abb-bdcd-09e87104070a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:11.495490 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8a96cf90-c01a-4abb-bdcd-09e87104070a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:11.503901 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8a96cf90-c01a-4abb-bdcd-09e87104070a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1679 microversion: 2.1 time: 0.237373 Jun 03 13:09:11.504470 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 245/494] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:11 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1679 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:11.589801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f4c0d2e-6229-4705-bce3-07f5f3c68c7b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:11.590595 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f4c0d2e-6229-4705-bce3-07f5f3c68c7b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] [instance: 0302f410-973f-4fde-b006-425696dadb3f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:11.598370 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f4c0d2e-6229-4705-bce3-07f5f3c68c7b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:11.598794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f4c0d2e-6229-4705-bce3-07f5f3c68c7b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:11.599697 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f4c0d2e-6229-4705-bce3-07f5f3c68c7b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:11.600132 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f4c0d2e-6229-4705-bce3-07f5f3c68c7b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:11.615193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-2f4c0d2e-6229-4705-bce3-07f5f3c68c7b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] HTTP exception thrown: Instance 0302f410-973f-4fde-b006-425696dadb3f could not be found. Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f4c0d2e-6229-4705-bce3-07f5f3c68c7b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Request method failure captured: Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f HTTP/1.1 Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgaq6Mk_wtQR3Ew8WYVX0IlIE0XpNN-bVQAfqumVGxXJO1Mg2KrymuJcQ3KJ166eMWzYDf5zKq5oW3npDzuoLpmnVLOIKoiClBaoP56ZB5jlXi7hW4HhL4CsC3o3fYkbT75Ty033AcsgQAHCB2tKrnIgkdHC8yg8J2EQPfISnqHqtW0 Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 80d06506691e4947b14192431bed4453 Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-TestMinimumBasicScenario-2082158207 Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:09:11.616847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:09:11.618398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d06506691e4947b14192431bed4453"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_80d06506691e4947b14192431bed4453"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/80d06506691e4947b14192431bed4453"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/80d06506691e4947b14192431bed4453"}]}] Jun 03 13:09:11.618398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-TestMinimumBasicScenario-2082158207 Jun 03 13:09:11.618398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 80d06506691e4947b14192431bed4453 Jun 03 13:09:11.618398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2082158207 Jun 03 13:09:11.618398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-TestMinimumBasicScenario-2082158207-project Jun 03 13:09:11.618398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:09:11.618398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:09:11.618398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 94dbfb6cf680454f883d43796f05c799 Jun 03 13:09:11.618398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-TestMinimumBasicScenario-2082158207-project Jun 03 13:09:11.618398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:09:11.618398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 0302f410-973f-4fde-b006-425696dadb3f could not be found. Jun 03 13:09:11.618398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '0302f410-973f-4fde-b006-425696dadb3f'} Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0302f410-973f-4fde-b006-425696dadb3f could not be found. Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:09:11.619180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0302f410-973f-4fde-b006-425696dadb3f could not be found. Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0302f410-973f-4fde-b006-425696dadb3f could not be found. Jun 03 13:09:11.620359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:11.621434 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f4c0d2e-6229-4705-bce3-07f5f3c68c7b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Returning 404 to user: Instance 0302f410-973f-4fde-b006-425696dadb3f could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:09:11.621434 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f4c0d2e-6229-4705-bce3-07f5f3c68c7b tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f" status: 404 len: 111 microversion: 2.1 time: 0.033055 Jun 03 13:09:11.621434 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 250/495] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:11 2022] GET /compute/v2.1/servers/0302f410-973f-4fde-b006-425696dadb3f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:09:11.628152 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-df4072f1-afd8-44d5-be7f-0152553bb0a4 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] Calling method '.version_select at 0x7fc5a41bbc10>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:11.654202 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-df4072f1-afd8-44d5-be7f-0152553bb0a4 tempest-TestMinimumBasicScenario-2082158207 tempest-TestMinimumBasicScenario-2082158207-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1476437325" status: 202 len: 0 microversion: 2.1 time: 0.030146 Jun 03 13:09:11.654786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 246/496] 10.222.0.58 () {58 vars in 1271 bytes} [Fri Jun 3 13:09:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1476437325 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:09:12.287236 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-32f8a6b8-cf60-4e90-8360-d3d4255c5a28 req-5fbb6401-c668-4f59-9fdc-01c367e7793f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a85c3fde-c3c5-4354-9c7a-2b432bbdf77c", "name": "network-vif-deleted", "tag": "58cc9c4e-cc54-49b9-8e2e-58c0ab81963a"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:12.297744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-32f8a6b8-cf60-4e90-8360-d3d4255c5a28 req-5fbb6401-c668-4f59-9fdc-01c367e7793f service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:12.298507 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-32f8a6b8-cf60-4e90-8360-d3d4255c5a28 req-5fbb6401-c668-4f59-9fdc-01c367e7793f service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:12.312663 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-32f8a6b8-cf60-4e90-8360-d3d4255c5a28 req-5fbb6401-c668-4f59-9fdc-01c367e7793f service nova] Creating event network-vif-deleted:58cc9c4e-cc54-49b9-8e2e-58c0ab81963a for instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c on hv-cinder-77954 Jun 03 13:09:12.318744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-32f8a6b8-cf60-4e90-8360-d3d4255c5a28 req-5fbb6401-c668-4f59-9fdc-01c367e7793f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035458 Jun 03 13:09:12.319587 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 251/497] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:12.521617 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-946ed087-6500-48e5-9805-885827078415 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:12.522283 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-946ed087-6500-48e5-9805-885827078415 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:12.529696 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-946ed087-6500-48e5-9805-885827078415 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:12.530497 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-946ed087-6500-48e5-9805-885827078415 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:12.531793 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-946ed087-6500-48e5-9805-885827078415 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:12.532226 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-946ed087-6500-48e5-9805-885827078415 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:12.571302 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-946ed087-6500-48e5-9805-885827078415 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:12.571922 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-946ed087-6500-48e5-9805-885827078415 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:12.572533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-946ed087-6500-48e5-9805-885827078415 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lazy-loading 'fault' on Instance uuid a85c3fde-c3c5-4354-9c7a-2b432bbdf77c {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:09:12.620564 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-946ed087-6500-48e5-9805-885827078415 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:12.628511 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-946ed087-6500-48e5-9805-885827078415 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 200 len: 1331 microversion: 2.1 time: 0.111481 Jun 03 13:09:12.629301 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 247/498] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:12 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:13.647612 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c91da6d7-df79-4215-be32-1e6297094473 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:13.648467 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c91da6d7-df79-4215-be32-1e6297094473 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:13.655691 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c91da6d7-df79-4215-be32-1e6297094473 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:13.656141 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c91da6d7-df79-4215-be32-1e6297094473 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:13.656950 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c91da6d7-df79-4215-be32-1e6297094473 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:13.657617 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c91da6d7-df79-4215-be32-1e6297094473 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:13.673511 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-c91da6d7-df79-4215-be32-1e6297094473 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c91da6d7-df79-4215-be32-1e6297094473 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c HTTP/1.1 Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:09:13.675221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:09:13.676495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:09:13.676495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:09:13.676495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:09:13.676495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:09:13.676495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:09:13.676495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:09:13.676495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:09:13.676495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:09:13.676495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:09:13.676495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:09:13.676495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:09:13.676495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': 'a85c3fde-c3c5-4354-9c7a-2b432bbdf77c'} Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:09:13.677209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:09:13.678435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:13.681943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c91da6d7-df79-4215-be32-1e6297094473 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 404 to user: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:09:13.681943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c91da6d7-df79-4215-be32-1e6297094473 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 404 len: 111 microversion: 2.1 time: 0.034137 Jun 03 13:09:13.681943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 252/499] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:13 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:09:13.686388 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bf55b514-12e7-4ad9-b45b-74874e9faff0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '.version_select at 0x7fc5a42f8790>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:13.708159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bf55b514-12e7-4ad9-b45b-74874e9faff0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-897276757" status: 202 len: 0 microversion: 2.1 time: 0.025747 Jun 03 13:09:13.708979 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 248/500] 10.222.0.58 () {58 vars in 1217 bytes} [Fri Jun 3 13:09:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-897276757 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:09:14.331526 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-70a4f53e-3ed3-4dfb-a1c7-31949b734e02 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: .version_select at 0x7fc5a43b9e50>, body: {"keypair": {"name": "tempest-keypair-864786495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvIfFtHbyzDml1GkiZAmM0+e2VkFVrezs9R3Y90zD1nkR/4wLYVJErU5MYcQgRvBBIgv8BlPa3cwPn45WNVGc4gJ4kVTxNErb9kscuymmuYIS9wFY8ld+wA5tFVUQssOQ=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:14.345846 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-70a4f53e-3ed3-4dfb-a1c7-31949b734e02 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:09:14.350079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-70a4f53e-3ed3-4dfb-a1c7-31949b734e02 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for user f2217b3c134d453fbdcb14853eed4e3b and project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:09:14.375953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-70a4f53e-3ed3-4dfb-a1c7-31949b734e02 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048291 Jun 03 13:09:14.377351 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 253/501] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Jun 3 13:09:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:15.999307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-253737424", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d6f325b-d3a4-43a7-8d89-d0ffbb50df9b"}], "security_groups": [{"name": "tempest-securitygroup--156430492"}], "key_name": "tempest-keypair-864786495", "user_data": "}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:16.166604 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] validate_networks() for [('6d6f325b-d3a4-43a7-8d89-d0ffbb50df9b', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:09:16.457925 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1864087514", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2140023348", "security_groups": [{"name": "tempest-secgroup-smoke-720825641"}], "block_device_mapping_v2": [{"uuid": "850afe75-d0ca-4fe0-ae6d-b12322140504", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d4fbee0d-2302-4e0a-ad7f-1d9dc25e1db8"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:16.736607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] validate_networks() for [('d4fbee0d-2302-4e0a-ad7f-1d9dc25e1db8', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:09:17.173541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:09:17.174067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:09:17.174471 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:09:17.174879 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:09:17.175285 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:09:17.184510 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:17.184976 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:17.185761 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:17.186229 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:17.204791 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:09:17.211530 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for user f2217b3c134d453fbdcb14853eed4e3b and project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:09:17.222888 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:09:17.225210 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:09:17.272860 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6ae899a3-8959-4933-9388-78a81bc5dae4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.278323 Jun 03 13:09:17.273581 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 249/502] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:09:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:09:17.283222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9947de08-6ae5-4c80-b878-117678ec2577 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:17.283843 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9947de08-6ae5-4c80-b878-117678ec2577 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:17.385006 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9947de08-6ae5-4c80-b878-117678ec2577 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:17.392229 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9947de08-6ae5-4c80-b878-117678ec2577 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1240 microversion: 2.1 time: 0.112754 Jun 03 13:09:17.392795 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 250/503] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:17 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:09:17.900217 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:09:17.900931 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:09:17.901173 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:09:17.901590 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:09:17.902387 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:09:17.911880 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:17.912368 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:17.913187 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:17.913691 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:17.950870 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Getting quotas for project 2fd9de1783e54cafadd25ecc97876288. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:09:17.962370 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Getting quotas for user 62f5e92899b84d5594a34643b662d233 and project 2fd9de1783e54cafadd25ecc97876288. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:09:18.058653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:09:18.067645 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='850afe75-d0ca-4fe0-ae6d-b12322140504',volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:09:18.244041 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f8881524-0cb5-43f2-a1e6-8c37bd20d254 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.791256 Jun 03 13:09:18.245746 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 254/504] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:09:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:09:18.255442 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3469b611-45e0-4d35-99e4-9ee3e035803c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:18.256032 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3469b611-45e0-4d35-99e4-9ee3e035803c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:18.323687 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3469b611-45e0-4d35-99e4-9ee3e035803c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:18.338139 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3469b611-45e0-4d35-99e4-9ee3e035803c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1095 microversion: 2.1 time: 0.086364 Jun 03 13:09:18.339562 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 251/505] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:18 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1095 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:09:18.414554 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5bc3958f-330b-4339-8312-a07b9272d1d0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:18.415196 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5bc3958f-330b-4339-8312-a07b9272d1d0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:18.432533 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bc3958f-330b-4339-8312-a07b9272d1d0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:18.433490 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bc3958f-330b-4339-8312-a07b9272d1d0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:18.434510 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bc3958f-330b-4339-8312-a07b9272d1d0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:18.435214 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5bc3958f-330b-4339-8312-a07b9272d1d0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:18.459371 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:18.567961 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5bc3958f-330b-4339-8312-a07b9272d1d0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:18.577138 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5bc3958f-330b-4339-8312-a07b9272d1d0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1300 microversion: 2.1 time: 0.171350 Jun 03 13:09:18.580612 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 255/506] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:18 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1300 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:19.362524 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-22129d3b-a036-4227-b135-969377b4c981 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:19.364051 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-22129d3b-a036-4227-b135-969377b4c981 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:19.384331 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-22129d3b-a036-4227-b135-969377b4c981 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:19.384887 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-22129d3b-a036-4227-b135-969377b4c981 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:19.391720 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-22129d3b-a036-4227-b135-969377b4c981 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:19.392729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-22129d3b-a036-4227-b135-969377b4c981 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:19.492305 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-22129d3b-a036-4227-b135-969377b4c981 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:19.501263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-22129d3b-a036-4227-b135-969377b4c981 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1201 microversion: 2.1 time: 0.146347 Jun 03 13:09:19.508272 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 252/507] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:19 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1201 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:19.595995 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e6f162dc-24ee-4dac-b9b4-c7255919c488 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:19.596622 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e6f162dc-24ee-4dac-b9b4-c7255919c488 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:19.604160 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6f162dc-24ee-4dac-b9b4-c7255919c488 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:19.604615 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6f162dc-24ee-4dac-b9b4-c7255919c488 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:19.605405 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6f162dc-24ee-4dac-b9b4-c7255919c488 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:19.605842 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6f162dc-24ee-4dac-b9b4-c7255919c488 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:19.864948 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e6f162dc-24ee-4dac-b9b4-c7255919c488 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:19.873554 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e6f162dc-24ee-4dac-b9b4-c7255919c488 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1365 microversion: 2.1 time: 0.281726 Jun 03 13:09:19.884579 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 256/508] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:19 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:20.527000 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d3eb1488-a969-46d3-a4e1-d502ed8f5fe7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:20.528343 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d3eb1488-a969-46d3-a4e1-d502ed8f5fe7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:20.543097 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3eb1488-a969-46d3-a4e1-d502ed8f5fe7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:20.543625 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3eb1488-a969-46d3-a4e1-d502ed8f5fe7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:20.547066 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3eb1488-a969-46d3-a4e1-d502ed8f5fe7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:20.547628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3eb1488-a969-46d3-a4e1-d502ed8f5fe7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:20.597085 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-3aff2650-7f3c-4b30-a455-8d7fad9401ae req-1c3816d7-1a43-41a5-bf85-d2a93f54ea3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328fcefb-287f-49d4-b35e-69edc918861e", "tag": "a578e8b6-9a30-47ce-b1fe-e7159b737a6b"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:20.623096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-3aff2650-7f3c-4b30-a455-8d7fad9401ae req-1c3816d7-1a43-41a5-bf85-d2a93f54ea3d service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:20.623357 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-3aff2650-7f3c-4b30-a455-8d7fad9401ae req-1c3816d7-1a43-41a5-bf85-d2a93f54ea3d service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:20.669016 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-3aff2650-7f3c-4b30-a455-8d7fad9401ae req-1c3816d7-1a43-41a5-bf85-d2a93f54ea3d service nova] Creating event network-changed:a578e8b6-9a30-47ce-b1fe-e7159b737a6b for instance 328fcefb-287f-49d4-b35e-69edc918861e on hv-cinder-77954 Jun 03 13:09:20.684495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-3aff2650-7f3c-4b30-a455-8d7fad9401ae req-1c3816d7-1a43-41a5-bf85-d2a93f54ea3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091640 Jun 03 13:09:20.687229 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 257/509] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:20.893019 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-867ce2d8-c2e4-48e8-b178-36b4a769c711 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:20.894747 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-867ce2d8-c2e4-48e8-b178-36b4a769c711 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:20.908197 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-867ce2d8-c2e4-48e8-b178-36b4a769c711 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:20.910041 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-867ce2d8-c2e4-48e8-b178-36b4a769c711 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:20.924922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-867ce2d8-c2e4-48e8-b178-36b4a769c711 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:20.925728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-867ce2d8-c2e4-48e8-b178-36b4a769c711 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:21.176089 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d3eb1488-a969-46d3-a4e1-d502ed8f5fe7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:21.187721 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d3eb1488-a969-46d3-a4e1-d502ed8f5fe7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.665430 Jun 03 13:09:21.199684 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 253/510] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:20 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:21.350541 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-867ce2d8-c2e4-48e8-b178-36b4a769c711 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:21.362042 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-867ce2d8-c2e4-48e8-b178-36b4a769c711 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1365 microversion: 2.1 time: 0.474079 Jun 03 13:09:21.363287 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 258/511] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:20 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1365 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:09:21.588950 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-09f417f2-b6d0-4913-86a1-11fd8df88320 req-55951ae2-0e07-4eb6-aef0-022e73b359a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba60da9-2b35-486d-94f0-3d134c9fdf3b", "tag": "2a060abd-a85c-4086-ba6b-e30215497801"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:21.611340 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-09f417f2-b6d0-4913-86a1-11fd8df88320 req-55951ae2-0e07-4eb6-aef0-022e73b359a4 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:21.612156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-09f417f2-b6d0-4913-86a1-11fd8df88320 req-55951ae2-0e07-4eb6-aef0-022e73b359a4 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:21.626045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-09f417f2-b6d0-4913-86a1-11fd8df88320 req-55951ae2-0e07-4eb6-aef0-022e73b359a4 service nova] Creating event network-changed:2a060abd-a85c-4086-ba6b-e30215497801 for instance cba60da9-2b35-486d-94f0-3d134c9fdf3b on hv-cinder-77954 Jun 03 13:09:21.631339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-09f417f2-b6d0-4913-86a1-11fd8df88320 req-55951ae2-0e07-4eb6-aef0-022e73b359a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047005 Jun 03 13:09:21.634329 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 254/512] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:22.205699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bd6675fb-fa28-41cb-bf8e-cdc991fa1de4 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:22.206807 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bd6675fb-fa28-41cb-bf8e-cdc991fa1de4 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:22.208993 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:22.218263 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd6675fb-fa28-41cb-bf8e-cdc991fa1de4 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:22.218876 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd6675fb-fa28-41cb-bf8e-cdc991fa1de4 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:22.219696 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd6675fb-fa28-41cb-bf8e-cdc991fa1de4 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:22.220129 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd6675fb-fa28-41cb-bf8e-cdc991fa1de4 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:22.387249 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4658b916-96f7-421f-a386-93ad175e25fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:22.388088 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4658b916-96f7-421f-a386-93ad175e25fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:22.396322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4658b916-96f7-421f-a386-93ad175e25fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:22.397513 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4658b916-96f7-421f-a386-93ad175e25fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:22.398415 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4658b916-96f7-421f-a386-93ad175e25fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:22.398693 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bd6675fb-fa28-41cb-bf8e-cdc991fa1de4 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:22.399059 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4658b916-96f7-421f-a386-93ad175e25fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:22.407179 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bd6675fb-fa28-41cb-bf8e-cdc991fa1de4 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.205412 Jun 03 13:09:22.407757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 259/513] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:22 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:22.553281 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4658b916-96f7-421f-a386-93ad175e25fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:22.560852 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4658b916-96f7-421f-a386-93ad175e25fb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1365 microversion: 2.1 time: 0.178291 Jun 03 13:09:22.569975 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 255/514] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:22 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:23.424906 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4c2e2d88-8143-48fb-a741-1810519d1a72 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:23.425480 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4c2e2d88-8143-48fb-a741-1810519d1a72 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:23.432568 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c2e2d88-8143-48fb-a741-1810519d1a72 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:23.433027 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c2e2d88-8143-48fb-a741-1810519d1a72 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:23.433838 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c2e2d88-8143-48fb-a741-1810519d1a72 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:23.434313 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c2e2d88-8143-48fb-a741-1810519d1a72 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:23.570898 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4c2e2d88-8143-48fb-a741-1810519d1a72 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:23.576777 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f910052f-5fea-426b-a3e1-006492c3fcec tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:23.577390 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f910052f-5fea-426b-a3e1-006492c3fcec tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:23.578850 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4c2e2d88-8143-48fb-a741-1810519d1a72 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.158781 Jun 03 13:09:23.579612 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 260/515] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:23 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:23.584356 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f910052f-5fea-426b-a3e1-006492c3fcec tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:23.584812 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f910052f-5fea-426b-a3e1-006492c3fcec tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:23.585592 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f910052f-5fea-426b-a3e1-006492c3fcec tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:23.586035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f910052f-5fea-426b-a3e1-006492c3fcec tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:23.732907 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f910052f-5fea-426b-a3e1-006492c3fcec tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:23.741167 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f910052f-5fea-426b-a3e1-006492c3fcec tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1365 microversion: 2.1 time: 0.168265 Jun 03 13:09:23.741734 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 256/516] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:23 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:24.596411 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b2aa81e6-243c-4b7e-bcfd-065cabbdbf7b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:24.597028 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b2aa81e6-243c-4b7e-bcfd-065cabbdbf7b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:24.604122 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b2aa81e6-243c-4b7e-bcfd-065cabbdbf7b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:24.604568 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b2aa81e6-243c-4b7e-bcfd-065cabbdbf7b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:24.605394 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b2aa81e6-243c-4b7e-bcfd-065cabbdbf7b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:24.605942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b2aa81e6-243c-4b7e-bcfd-065cabbdbf7b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:24.757748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b2aa81e6-243c-4b7e-bcfd-065cabbdbf7b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:24.758487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f9c0675d-f60d-4363-9fdc-2454c3c50cfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:24.759106 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f9c0675d-f60d-4363-9fdc-2454c3c50cfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:24.765509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b2aa81e6-243c-4b7e-bcfd-065cabbdbf7b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.173581 Jun 03 13:09:24.765664 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f9c0675d-f60d-4363-9fdc-2454c3c50cfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:24.766084 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 261/517] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:24 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:24.766227 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f9c0675d-f60d-4363-9fdc-2454c3c50cfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:24.766959 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f9c0675d-f60d-4363-9fdc-2454c3c50cfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:24.767398 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f9c0675d-f60d-4363-9fdc-2454c3c50cfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:24.913166 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f9c0675d-f60d-4363-9fdc-2454c3c50cfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:24.921021 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f9c0675d-f60d-4363-9fdc-2454c3c50cfb tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1365 microversion: 2.1 time: 0.166435 Jun 03 13:09:24.921561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 257/518] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:24 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:25.783664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8ba07731-ed9b-4130-92fc-af49972ebd58 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:25.784318 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8ba07731-ed9b-4130-92fc-af49972ebd58 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:25.791458 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ba07731-ed9b-4130-92fc-af49972ebd58 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:25.791992 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ba07731-ed9b-4130-92fc-af49972ebd58 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:25.792780 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ba07731-ed9b-4130-92fc-af49972ebd58 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:25.793225 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8ba07731-ed9b-4130-92fc-af49972ebd58 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:25.930279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8ba07731-ed9b-4130-92fc-af49972ebd58 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:25.938578 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8aa61acb-96d7-47d0-815f-ab0838052ffa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:25.939178 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8ba07731-ed9b-4130-92fc-af49972ebd58 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.159623 Jun 03 13:09:25.940060 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8aa61acb-96d7-47d0-815f-ab0838052ffa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:25.940304 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 262/519] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:25 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:25.947327 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8aa61acb-96d7-47d0-815f-ab0838052ffa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:25.948376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8aa61acb-96d7-47d0-815f-ab0838052ffa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:25.949370 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8aa61acb-96d7-47d0-815f-ab0838052ffa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:25.949974 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8aa61acb-96d7-47d0-815f-ab0838052ffa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:26.100215 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8aa61acb-96d7-47d0-815f-ab0838052ffa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:26.107771 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8aa61acb-96d7-47d0-815f-ab0838052ffa tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1365 microversion: 2.1 time: 0.174043 Jun 03 13:09:26.108342 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 258/520] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:25 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:09:26.959033 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a04431bf-9d82-489c-b8c0-e98bfcc334e1 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:26.959693 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a04431bf-9d82-489c-b8c0-e98bfcc334e1 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:26.967701 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a04431bf-9d82-489c-b8c0-e98bfcc334e1 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:26.968236 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a04431bf-9d82-489c-b8c0-e98bfcc334e1 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:26.969148 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a04431bf-9d82-489c-b8c0-e98bfcc334e1 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:26.969671 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a04431bf-9d82-489c-b8c0-e98bfcc334e1 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:27.115244 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a04431bf-9d82-489c-b8c0-e98bfcc334e1 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:27.124214 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a04431bf-9d82-489c-b8c0-e98bfcc334e1 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.170285 Jun 03 13:09:27.124796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 263/521] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:26 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:27.125030 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dbe98372-0bf6-4283-bbc4-d8163cc8a085 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:27.125585 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dbe98372-0bf6-4283-bbc4-d8163cc8a085 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:27.129140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:27.132875 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dbe98372-0bf6-4283-bbc4-d8163cc8a085 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:27.133325 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dbe98372-0bf6-4283-bbc4-d8163cc8a085 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:27.134122 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dbe98372-0bf6-4283-bbc4-d8163cc8a085 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:27.134574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dbe98372-0bf6-4283-bbc4-d8163cc8a085 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:27.194759 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:27.279965 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dbe98372-0bf6-4283-bbc4-d8163cc8a085 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:27.288301 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dbe98372-0bf6-4283-bbc4-d8163cc8a085 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1365 microversion: 2.1 time: 0.167347 Jun 03 13:09:27.288901 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 259/522] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:27 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:09:27.592226 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-d610ee8c-7c9a-48e2-a7e8-69ede1516d3f req-e883ae16-fd86-4253-879e-e6603e660330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328fcefb-287f-49d4-b35e-69edc918861e", "name": "network-vif-plugged", "status": "completed", "tag": "a578e8b6-9a30-47ce-b1fe-e7159b737a6b"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:27.600593 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d610ee8c-7c9a-48e2-a7e8-69ede1516d3f req-e883ae16-fd86-4253-879e-e6603e660330 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:27.601058 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d610ee8c-7c9a-48e2-a7e8-69ede1516d3f req-e883ae16-fd86-4253-879e-e6603e660330 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:27.614487 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-d610ee8c-7c9a-48e2-a7e8-69ede1516d3f req-e883ae16-fd86-4253-879e-e6603e660330 service nova] Creating event network-vif-plugged:a578e8b6-9a30-47ce-b1fe-e7159b737a6b for instance 328fcefb-287f-49d4-b35e-69edc918861e on hv-cinder-77954 Jun 03 13:09:27.621653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-d610ee8c-7c9a-48e2-a7e8-69ede1516d3f req-e883ae16-fd86-4253-879e-e6603e660330 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216209 Jun 03 13:09:27.622418 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 264/523] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:28.145639 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-50b12d54-8b0b-4a93-bab5-6b1cb5023293 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:28.146533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-50b12d54-8b0b-4a93-bab5-6b1cb5023293 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:28.157492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50b12d54-8b0b-4a93-bab5-6b1cb5023293 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:28.158325 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50b12d54-8b0b-4a93-bab5-6b1cb5023293 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:28.159377 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50b12d54-8b0b-4a93-bab5-6b1cb5023293 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:28.159806 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50b12d54-8b0b-4a93-bab5-6b1cb5023293 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:28.302786 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:28.304725 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=10 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:28.307649 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-50b12d54-8b0b-4a93-bab5-6b1cb5023293 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:28.308796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-524afa0b-731a-4f17-ba32-01445f4ad459 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:28.309530 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-524afa0b-731a-4f17-ba32-01445f4ad459 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:28.315654 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-50b12d54-8b0b-4a93-bab5-6b1cb5023293 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.176641 Jun 03 13:09:28.316215 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 260/524] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:28 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:28.316717 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-524afa0b-731a-4f17-ba32-01445f4ad459 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:28.317251 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-524afa0b-731a-4f17-ba32-01445f4ad459 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:28.318035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-524afa0b-731a-4f17-ba32-01445f4ad459 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:28.318530 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-524afa0b-731a-4f17-ba32-01445f4ad459 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:28.452567 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-524afa0b-731a-4f17-ba32-01445f4ad459 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:28.460363 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-524afa0b-731a-4f17-ba32-01445f4ad459 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1365 microversion: 2.1 time: 0.158567 Jun 03 13:09:28.460927 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 265/525] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:28 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:29.336748 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-182c7c05-350c-4637-b9ea-16c9cb812231 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:29.337750 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-182c7c05-350c-4637-b9ea-16c9cb812231 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:29.340724 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=10 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:29.349686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-182c7c05-350c-4637-b9ea-16c9cb812231 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:29.350140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-182c7c05-350c-4637-b9ea-16c9cb812231 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:29.350958 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-182c7c05-350c-4637-b9ea-16c9cb812231 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:29.351435 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-182c7c05-350c-4637-b9ea-16c9cb812231 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:29.477537 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-44f80204-d291-4c4c-a22b-69e109179704 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:29.478097 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-44f80204-d291-4c4c-a22b-69e109179704 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:29.484876 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-44f80204-d291-4c4c-a22b-69e109179704 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:29.485323 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-44f80204-d291-4c4c-a22b-69e109179704 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:29.486062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-44f80204-d291-4c4c-a22b-69e109179704 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:29.486528 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-44f80204-d291-4c4c-a22b-69e109179704 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:29.489571 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-182c7c05-350c-4637-b9ea-16c9cb812231 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:29.497413 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-182c7c05-350c-4637-b9ea-16c9cb812231 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.167341 Jun 03 13:09:29.497987 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 261/526] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:29 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:29.619964 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-44f80204-d291-4c4c-a22b-69e109179704 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:29.627482 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-44f80204-d291-4c4c-a22b-69e109179704 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1365 microversion: 2.1 time: 0.154035 Jun 03 13:09:29.628349 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 266/527] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:29 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:30.515278 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-46a60d6b-b4d1-4f7e-8596-ef2ec6bcb319 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:30.515958 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-46a60d6b-b4d1-4f7e-8596-ef2ec6bcb319 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:30.523856 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-46a60d6b-b4d1-4f7e-8596-ef2ec6bcb319 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:30.524360 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-46a60d6b-b4d1-4f7e-8596-ef2ec6bcb319 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:30.525211 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-46a60d6b-b4d1-4f7e-8596-ef2ec6bcb319 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:30.525697 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-46a60d6b-b4d1-4f7e-8596-ef2ec6bcb319 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:30.643661 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4808a750-75ec-4f6a-b8fe-02ee251bc6f2 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:30.644861 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4808a750-75ec-4f6a-b8fe-02ee251bc6f2 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:30.651832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4808a750-75ec-4f6a-b8fe-02ee251bc6f2 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:30.652285 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4808a750-75ec-4f6a-b8fe-02ee251bc6f2 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:30.653059 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4808a750-75ec-4f6a-b8fe-02ee251bc6f2 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:30.653491 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4808a750-75ec-4f6a-b8fe-02ee251bc6f2 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:30.668252 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-46a60d6b-b4d1-4f7e-8596-ef2ec6bcb319 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:30.676477 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-46a60d6b-b4d1-4f7e-8596-ef2ec6bcb319 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.165543 Jun 03 13:09:30.685520 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 262/528] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:30 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:30.787602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4808a750-75ec-4f6a-b8fe-02ee251bc6f2 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:30.795276 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4808a750-75ec-4f6a-b8fe-02ee251bc6f2 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1554 microversion: 2.1 time: 0.155514 Jun 03 13:09:30.795847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 267/529] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:30 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:30.818576 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7f351a7c-ec4f-4026-a5fc-42ba5eeb540a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:30.819078 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7f351a7c-ec4f-4026-a5fc-42ba5eeb540a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:30.825522 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f351a7c-ec4f-4026-a5fc-42ba5eeb540a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:30.825978 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f351a7c-ec4f-4026-a5fc-42ba5eeb540a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:30.826785 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f351a7c-ec4f-4026-a5fc-42ba5eeb540a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:30.827222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7f351a7c-ec4f-4026-a5fc-42ba5eeb540a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:30.908382 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7f351a7c-ec4f-4026-a5fc-42ba5eeb540a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094370 Jun 03 13:09:30.909223 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 263/530] 10.222.0.58 () {58 vars in 1274 bytes} [Fri Jun 3 13:09:30 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:31.693628 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-aef0c85a-e817-4ef6-aa9a-acaa52ee9e52 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:31.694440 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-aef0c85a-e817-4ef6-aa9a-acaa52ee9e52 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:31.701893 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aef0c85a-e817-4ef6-aa9a-acaa52ee9e52 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:31.702391 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aef0c85a-e817-4ef6-aa9a-acaa52ee9e52 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:31.703211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aef0c85a-e817-4ef6-aa9a-acaa52ee9e52 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:31.703652 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-aef0c85a-e817-4ef6-aa9a-acaa52ee9e52 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:31.841411 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-aef0c85a-e817-4ef6-aa9a-acaa52ee9e52 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:31.850038 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-aef0c85a-e817-4ef6-aa9a-acaa52ee9e52 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.160602 Jun 03 13:09:31.851193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 268/531] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:31 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:31.865894 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-c39a16ca-9cf9-43d2-ba31-56b41a47741e req-ed56fe1c-ce6e-41dc-acc3-d5e240ec1abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328fcefb-287f-49d4-b35e-69edc918861e", "tag": "a578e8b6-9a30-47ce-b1fe-e7159b737a6b"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:31.874029 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-c39a16ca-9cf9-43d2-ba31-56b41a47741e req-ed56fe1c-ce6e-41dc-acc3-d5e240ec1abd service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:31.874525 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-c39a16ca-9cf9-43d2-ba31-56b41a47741e req-ed56fe1c-ce6e-41dc-acc3-d5e240ec1abd service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:31.885652 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-c39a16ca-9cf9-43d2-ba31-56b41a47741e req-ed56fe1c-ce6e-41dc-acc3-d5e240ec1abd service nova] Creating event network-changed:a578e8b6-9a30-47ce-b1fe-e7159b737a6b for instance 328fcefb-287f-49d4-b35e-69edc918861e on hv-cinder-77954 Jun 03 13:09:31.890705 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-c39a16ca-9cf9-43d2-ba31-56b41a47741e req-ed56fe1c-ce6e-41dc-acc3-d5e240ec1abd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029512 Jun 03 13:09:31.891340 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 264/532] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:32.868241 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e6ecf8b1-ac88-4ca3-9ba5-ef1e2c07326c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:32.868885 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e6ecf8b1-ac88-4ca3-9ba5-ef1e2c07326c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:32.875918 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6ecf8b1-ac88-4ca3-9ba5-ef1e2c07326c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:32.876368 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6ecf8b1-ac88-4ca3-9ba5-ef1e2c07326c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:32.877155 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6ecf8b1-ac88-4ca3-9ba5-ef1e2c07326c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:32.877591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e6ecf8b1-ac88-4ca3-9ba5-ef1e2c07326c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:33.008926 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e6ecf8b1-ac88-4ca3-9ba5-ef1e2c07326c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:33.017359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e6ecf8b1-ac88-4ca3-9ba5-ef1e2c07326c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.153111 Jun 03 13:09:33.017954 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 269/533] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:32 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:34.036680 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8d875584-49fd-46c0-9805-40d443e5252b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:34.037334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8d875584-49fd-46c0-9805-40d443e5252b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:34.043921 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d875584-49fd-46c0-9805-40d443e5252b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:34.044369 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d875584-49fd-46c0-9805-40d443e5252b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:34.045153 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d875584-49fd-46c0-9805-40d443e5252b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:34.045563 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d875584-49fd-46c0-9805-40d443e5252b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:34.191826 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8d875584-49fd-46c0-9805-40d443e5252b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:34.195383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=100 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:34.200074 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8d875584-49fd-46c0-9805-40d443e5252b tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.168736 Jun 03 13:09:34.200654 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 265/534] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:34 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:35.219320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ef8edf16-c20e-48e9-939f-25c4d4159070 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:35.219917 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ef8edf16-c20e-48e9-939f-25c4d4159070 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:35.227884 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef8edf16-c20e-48e9-939f-25c4d4159070 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:35.228334 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef8edf16-c20e-48e9-939f-25c4d4159070 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:35.229112 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef8edf16-c20e-48e9-939f-25c4d4159070 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:35.229549 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef8edf16-c20e-48e9-939f-25c4d4159070 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:35.369069 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ef8edf16-c20e-48e9-939f-25c4d4159070 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:35.376687 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ef8edf16-c20e-48e9-939f-25c4d4159070 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.163219 Jun 03 13:09:35.377465 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 270/535] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:35 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:35.446254 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-152d543d-bce5-45f0-8ee4-a891490a1d22 req-2720f8ec-4028-4df0-bf50-8aa84a6d4b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba60da9-2b35-486d-94f0-3d134c9fdf3b", "name": "network-vif-plugged", "status": "completed", "tag": "2a060abd-a85c-4086-ba6b-e30215497801"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:35.457302 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-152d543d-bce5-45f0-8ee4-a891490a1d22 req-2720f8ec-4028-4df0-bf50-8aa84a6d4b2f service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:35.457756 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-152d543d-bce5-45f0-8ee4-a891490a1d22 req-2720f8ec-4028-4df0-bf50-8aa84a6d4b2f service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:35.469299 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-152d543d-bce5-45f0-8ee4-a891490a1d22 req-2720f8ec-4028-4df0-bf50-8aa84a6d4b2f service nova] Creating event network-vif-plugged:2a060abd-a85c-4086-ba6b-e30215497801 for instance cba60da9-2b35-486d-94f0-3d134c9fdf3b on hv-cinder-77954 Jun 03 13:09:35.474598 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-152d543d-bce5-45f0-8ee4-a891490a1d22 req-2720f8ec-4028-4df0-bf50-8aa84a6d4b2f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032335 Jun 03 13:09:35.475596 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 266/536] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:36.397099 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-630066c9-0168-4005-8f68-db1625cefdac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:36.397730 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-630066c9-0168-4005-8f68-db1625cefdac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:36.405362 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-630066c9-0168-4005-8f68-db1625cefdac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:36.405819 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-630066c9-0168-4005-8f68-db1625cefdac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:36.406631 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-630066c9-0168-4005-8f68-db1625cefdac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:36.407066 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-630066c9-0168-4005-8f68-db1625cefdac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:36.557634 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-630066c9-0168-4005-8f68-db1625cefdac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:36.565286 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-630066c9-0168-4005-8f68-db1625cefdac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1266 microversion: 2.1 time: 0.174910 Jun 03 13:09:36.566370 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 271/537] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:36 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:37.582882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-90c21401-b706-4293-bdc5-f640d7edcd27 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:37.583500 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-90c21401-b706-4293-bdc5-f640d7edcd27 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:37.591363 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90c21401-b706-4293-bdc5-f640d7edcd27 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:37.591811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90c21401-b706-4293-bdc5-f640d7edcd27 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:37.592587 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90c21401-b706-4293-bdc5-f640d7edcd27 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:37.593017 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-90c21401-b706-4293-bdc5-f640d7edcd27 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:37.737452 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-90c21401-b706-4293-bdc5-f640d7edcd27 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:37.745834 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-90c21401-b706-4293-bdc5-f640d7edcd27 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1454 microversion: 2.1 time: 0.167537 Jun 03 13:09:37.746460 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 267/538] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:37 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1454 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:37.771670 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-758e9ee5-6358-49a5-84b9-d9ac7ba29a8e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:37.772397 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-758e9ee5-6358-49a5-84b9-d9ac7ba29a8e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:37.782087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-758e9ee5-6358-49a5-84b9-d9ac7ba29a8e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:37.782891 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-758e9ee5-6358-49a5-84b9-d9ac7ba29a8e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:37.784221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-758e9ee5-6358-49a5-84b9-d9ac7ba29a8e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:37.784997 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-758e9ee5-6358-49a5-84b9-d9ac7ba29a8e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:37.934253 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-758e9ee5-6358-49a5-84b9-d9ac7ba29a8e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:37.944619 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-758e9ee5-6358-49a5-84b9-d9ac7ba29a8e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1454 microversion: 2.1 time: 0.179364 Jun 03 13:09:37.945183 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 272/539] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:37 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1454 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:38.191227 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e1addfe1-ebfc-4c29-bcc3-41827e2d0581 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:38.191734 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e1addfe1-ebfc-4c29-bcc3-41827e2d0581 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:38.198270 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1addfe1-ebfc-4c29-bcc3-41827e2d0581 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:38.198726 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1addfe1-ebfc-4c29-bcc3-41827e2d0581 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:38.199527 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1addfe1-ebfc-4c29-bcc3-41827e2d0581 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:38.199966 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e1addfe1-ebfc-4c29-bcc3-41827e2d0581 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:38.283805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-e1addfe1-ebfc-4c29-bcc3-41827e2d0581 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lazy-loading 'services' on Instance uuid a6908a57-1971-4cba-abd3-b6d365aebff0 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:09:38.358610 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e1addfe1-ebfc-4c29-bcc3-41827e2d0581 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-volume_attachments/275a6971-4e54-4835-8765-b366e8d2388b" status: 202 len: 0 microversion: 2.1 time: 0.171998 Jun 03 13:09:38.359226 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 268/540] 10.222.0.58 () {58 vars in 1415 bytes} [Fri Jun 3 13:09:38 2022] DELETE /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-volume_attachments/275a6971-4e54-4835-8765-b366e8d2388b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:09:38.369538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4ffbd9d1-456f-45df-a143-6d798210f8fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:38.370924 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4ffbd9d1-456f-45df-a143-6d798210f8fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:38.376896 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ffbd9d1-456f-45df-a143-6d798210f8fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:38.377356 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ffbd9d1-456f-45df-a143-6d798210f8fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:38.378259 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ffbd9d1-456f-45df-a143-6d798210f8fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:38.378691 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4ffbd9d1-456f-45df-a143-6d798210f8fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:38.397384 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=100 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:38.415530 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4ffbd9d1-456f-45df-a143-6d798210f8fb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050448 Jun 03 13:09:38.416186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 273/541] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:09:38 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:39.429164 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0aafcad8-da9a-4bfd-8ba1-45de70eace0b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:39.430582 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0aafcad8-da9a-4bfd-8ba1-45de70eace0b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:39.437450 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0aafcad8-da9a-4bfd-8ba1-45de70eace0b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:39.437899 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0aafcad8-da9a-4bfd-8ba1-45de70eace0b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:39.438708 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0aafcad8-da9a-4bfd-8ba1-45de70eace0b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:39.439151 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0aafcad8-da9a-4bfd-8ba1-45de70eace0b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:39.468370 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0aafcad8-da9a-4bfd-8ba1-45de70eace0b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044457 Jun 03 13:09:39.469254 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 269/542] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:09:39 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:09:39.547925 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-458ba560-249f-4be4-9e33-47da4dc8b19e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:39.548355 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-458ba560-249f-4be4-9e33-47da4dc8b19e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:39.555752 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-458ba560-249f-4be4-9e33-47da4dc8b19e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:39.556207 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-458ba560-249f-4be4-9e33-47da4dc8b19e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:39.556989 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-458ba560-249f-4be4-9e33-47da4dc8b19e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:39.557429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-458ba560-249f-4be4-9e33-47da4dc8b19e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:39.582999 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-458ba560-249f-4be4-9e33-47da4dc8b19e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:09:39.663628 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-458ba560-249f-4be4-9e33-47da4dc8b19e tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 204 len: 0 microversion: 2.1 time: 0.121145 Jun 03 13:09:39.664410 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 274/543] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:09:39 2022] DELETE /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:09:39.673593 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e7359d1a-07cc-4a37-9f9e-90c709d39489 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:39.674233 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e7359d1a-07cc-4a37-9f9e-90c709d39489 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:39.681134 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7359d1a-07cc-4a37-9f9e-90c709d39489 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:39.681520 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7359d1a-07cc-4a37-9f9e-90c709d39489 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:39.682358 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7359d1a-07cc-4a37-9f9e-90c709d39489 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:39.682813 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e7359d1a-07cc-4a37-9f9e-90c709d39489 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:39.793540 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-6f771516-5bf9-4414-bdf0-dc197b0d5559 req-b176c61d-e85c-49c7-bc4f-9d5a8da276b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba60da9-2b35-486d-94f0-3d134c9fdf3b", "tag": "2a060abd-a85c-4086-ba6b-e30215497801"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:39.803500 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-6f771516-5bf9-4414-bdf0-dc197b0d5559 req-b176c61d-e85c-49c7-bc4f-9d5a8da276b5 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:39.804065 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-6f771516-5bf9-4414-bdf0-dc197b0d5559 req-b176c61d-e85c-49c7-bc4f-9d5a8da276b5 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:39.815768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-6f771516-5bf9-4414-bdf0-dc197b0d5559 req-b176c61d-e85c-49c7-bc4f-9d5a8da276b5 service nova] Creating event network-changed:2a060abd-a85c-4086-ba6b-e30215497801 for instance cba60da9-2b35-486d-94f0-3d134c9fdf3b on hv-cinder-77954 Jun 03 13:09:39.822078 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-6f771516-5bf9-4414-bdf0-dc197b0d5559 req-b176c61d-e85c-49c7-bc4f-9d5a8da276b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033042 Jun 03 13:09:39.822802 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 275/544] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:39.856207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e7359d1a-07cc-4a37-9f9e-90c709d39489 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:39.864439 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e7359d1a-07cc-4a37-9f9e-90c709d39489 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1688 microversion: 2.1 time: 0.195557 Jun 03 13:09:39.865170 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 270/545] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:39 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:40.882089 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c1265aca-1b86-4092-b5f3-f5fdcff0c66b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:40.882770 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c1265aca-1b86-4092-b5f3-f5fdcff0c66b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:40.889809 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1265aca-1b86-4092-b5f3-f5fdcff0c66b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:40.890288 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1265aca-1b86-4092-b5f3-f5fdcff0c66b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:40.891088 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1265aca-1b86-4092-b5f3-f5fdcff0c66b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:40.891507 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c1265aca-1b86-4092-b5f3-f5fdcff0c66b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:41.032205 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c1265aca-1b86-4092-b5f3-f5fdcff0c66b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:41.041253 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c1265aca-1b86-4092-b5f3-f5fdcff0c66b tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1688 microversion: 2.1 time: 0.163912 Jun 03 13:09:41.041822 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 276/546] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:40 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:42.059012 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-96e36311-41c0-479b-8dfa-d70256060da3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:42.059654 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-96e36311-41c0-479b-8dfa-d70256060da3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:42.066798 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96e36311-41c0-479b-8dfa-d70256060da3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:42.067243 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96e36311-41c0-479b-8dfa-d70256060da3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:42.068136 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96e36311-41c0-479b-8dfa-d70256060da3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:42.068511 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-96e36311-41c0-479b-8dfa-d70256060da3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:42.204048 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-96e36311-41c0-479b-8dfa-d70256060da3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:42.212189 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-96e36311-41c0-479b-8dfa-d70256060da3 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1688 microversion: 2.1 time: 0.157192 Jun 03 13:09:42.212755 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 271/547] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:42 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:43.230253 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-44cb9580-23d4-4a55-9202-50bd70f36964 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:43.230904 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-44cb9580-23d4-4a55-9202-50bd70f36964 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:43.237728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-44cb9580-23d4-4a55-9202-50bd70f36964 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:43.238179 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-44cb9580-23d4-4a55-9202-50bd70f36964 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:43.239339 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-44cb9580-23d4-4a55-9202-50bd70f36964 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:43.239850 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-44cb9580-23d4-4a55-9202-50bd70f36964 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:43.372029 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-44cb9580-23d4-4a55-9202-50bd70f36964 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:43.379862 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-44cb9580-23d4-4a55-9202-50bd70f36964 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1688 microversion: 2.1 time: 0.153649 Jun 03 13:09:43.380476 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 277/548] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:43 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:44.375821 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-298c5ca1-8c29-468b-9f4c-2e6c0fa832b8 req-00314fb1-855d-4dd2-936b-d837f894866a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6908a57-1971-4cba-abd3-b6d365aebff0", "name": "network-vif-deleted", "tag": "7485bbe7-40a4-4a93-bae4-e9f18264d13a"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:44.387167 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-298c5ca1-8c29-468b-9f4c-2e6c0fa832b8 req-00314fb1-855d-4dd2-936b-d837f894866a service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:44.387612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-298c5ca1-8c29-468b-9f4c-2e6c0fa832b8 req-00314fb1-855d-4dd2-936b-d837f894866a service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:44.398594 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b0e1de13-8c08-43ca-b237-c76439f60b84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:44.399952 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b0e1de13-8c08-43ca-b237-c76439f60b84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:44.407414 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-298c5ca1-8c29-468b-9f4c-2e6c0fa832b8 req-00314fb1-855d-4dd2-936b-d837f894866a service nova] Creating event network-vif-deleted:7485bbe7-40a4-4a93-bae4-e9f18264d13a for instance a6908a57-1971-4cba-abd3-b6d365aebff0 on hv-cinder-77954 Jun 03 13:09:44.412825 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-298c5ca1-8c29-468b-9f4c-2e6c0fa832b8 req-00314fb1-855d-4dd2-936b-d837f894866a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040977 Jun 03 13:09:44.413759 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 272/549] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:44.415129 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0e1de13-8c08-43ca-b237-c76439f60b84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:44.415860 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0e1de13-8c08-43ca-b237-c76439f60b84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:44.416885 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0e1de13-8c08-43ca-b237-c76439f60b84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:44.417548 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b0e1de13-8c08-43ca-b237-c76439f60b84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:44.492625 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b0e1de13-8c08-43ca-b237-c76439f60b84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:44.500898 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b0e1de13-8c08-43ca-b237-c76439f60b84 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 200 len: 1330 microversion: 2.1 time: 0.107710 Jun 03 13:09:44.506497 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 278/550] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:44 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 1330 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:45.518896 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-58db74b7-5441-4fc7-8d96-138ce8f86d32 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:45.519593 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-58db74b7-5441-4fc7-8d96-138ce8f86d32 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: a6908a57-1971-4cba-abd3-b6d365aebff0] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:45.526898 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58db74b7-5441-4fc7-8d96-138ce8f86d32 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:45.527346 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58db74b7-5441-4fc7-8d96-138ce8f86d32 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:45.528118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58db74b7-5441-4fc7-8d96-138ce8f86d32 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:45.528550 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-58db74b7-5441-4fc7-8d96-138ce8f86d32 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:45.542986 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-58db74b7-5441-4fc7-8d96-138ce8f86d32 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] HTTP exception thrown: Instance a6908a57-1971-4cba-abd3-b6d365aebff0 could not be found. Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-58db74b7-5441-4fc7-8d96-138ce8f86d32 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Request method failure captured: Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 HTTP/1.1 Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgZb6OIAoFXauJTIaqiZtgkaDduvm40Tmnjoq76MT68LNhb3WKogFBe-eGYSp6zeb8cQNqB8O0IkSk2-MR9STml5Hwl6q8-MoxwD30LLRKESM7goJVvYLGOEIN6xysNErIWQyMbX0Xw6HJDjU3-WmLkhh9NSHZX5VfSX6Mgt9tOPOxQ Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 45170704be9845929be13eb3a96eeb07 Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:09:45.544764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:09:45.546345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45170704be9845929be13eb3a96eeb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45170704be9845929be13eb3a96eeb07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45170704be9845929be13eb3a96eeb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45170704be9845929be13eb3a96eeb07"}]}] Jun 03 13:09:45.546345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:09:45.546345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 45170704be9845929be13eb3a96eeb07 Jun 03 13:09:45.546345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:09:45.546345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-ServerRescueNegativeTestJSON-972257074-project Jun 03 13:09:45.546345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:09:45.546345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:09:45.546345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 010c4d5ba6b847b79d3127787db2ddd6 Jun 03 13:09:45.546345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-972257074-project Jun 03 13:09:45.546345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:09:45.546345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance a6908a57-1971-4cba-abd3-b6d365aebff0 could not be found. Jun 03 13:09:45.546345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': 'a6908a57-1971-4cba-abd3-b6d365aebff0'} Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6908a57-1971-4cba-abd3-b6d365aebff0 could not be found. Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:09:45.547118 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6908a57-1971-4cba-abd3-b6d365aebff0 could not be found. Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6908a57-1971-4cba-abd3-b6d365aebff0 could not be found. Jun 03 13:09:45.548416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:45.549545 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-58db74b7-5441-4fc7-8d96-138ce8f86d32 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Returning 404 to user: Instance a6908a57-1971-4cba-abd3-b6d365aebff0 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:09:45.549545 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-58db74b7-5441-4fc7-8d96-138ce8f86d32 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0" status: 404 len: 111 microversion: 2.1 time: 0.032114 Jun 03 13:09:45.549545 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 273/551] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:45 2022] GET /compute/v2.1/servers/a6908a57-1971-4cba-abd3-b6d365aebff0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:09:45.555408 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-49d588ad-d902-4e4b-b336-702a5311da52 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '.version_select at 0x7fc5a43123a0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:45.575788 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-49d588ad-d902-4e4b-b336-702a5311da52 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-708785093" status: 202 len: 0 microversion: 2.1 time: 0.024568 Jun 03 13:09:45.576353 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 279/552] 10.222.0.58 () {58 vars in 1217 bytes} [Fri Jun 3 13:09:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-708785093 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:09:48.498436 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-18c8b4db-74a8-44ca-9c71-370fb9b1370f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:48.498979 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-18c8b4db-74a8-44ca-9c71-370fb9b1370f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:48.505857 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18c8b4db-74a8-44ca-9c71-370fb9b1370f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:48.506336 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18c8b4db-74a8-44ca-9c71-370fb9b1370f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:48.507207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18c8b4db-74a8-44ca-9c71-370fb9b1370f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:48.507633 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18c8b4db-74a8-44ca-9c71-370fb9b1370f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:48.535280 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-18c8b4db-74a8-44ca-9c71-370fb9b1370f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:09:48.611964 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-18c8b4db-74a8-44ca-9c71-370fb9b1370f tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 204 len: 0 microversion: 2.1 time: 0.117170 Jun 03 13:09:48.612797 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 274/553] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:09:48 2022] DELETE /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:09:48.621888 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c7cc1e4a-5185-40ef-8f9c-c2bc0440d744 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:48.622514 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c7cc1e4a-5185-40ef-8f9c-c2bc0440d744 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:48.628547 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7cc1e4a-5185-40ef-8f9c-c2bc0440d744 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:48.629000 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7cc1e4a-5185-40ef-8f9c-c2bc0440d744 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:48.629774 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7cc1e4a-5185-40ef-8f9c-c2bc0440d744 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:48.630239 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c7cc1e4a-5185-40ef-8f9c-c2bc0440d744 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:48.764208 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c7cc1e4a-5185-40ef-8f9c-c2bc0440d744 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:48.772396 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c7cc1e4a-5185-40ef-8f9c-c2bc0440d744 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1506 microversion: 2.1 time: 0.155180 Jun 03 13:09:48.772956 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 280/554] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:48 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:49.790089 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9ab1e65b-19ec-470d-8888-ff6418983340 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:49.790710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9ab1e65b-19ec-470d-8888-ff6418983340 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:49.797211 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ab1e65b-19ec-470d-8888-ff6418983340 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:49.797741 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ab1e65b-19ec-470d-8888-ff6418983340 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:49.798544 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ab1e65b-19ec-470d-8888-ff6418983340 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:49.798976 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ab1e65b-19ec-470d-8888-ff6418983340 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:49.867877 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9ab1e65b-19ec-470d-8888-ff6418983340 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:49.878223 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9ab1e65b-19ec-470d-8888-ff6418983340 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 200 len: 1464 microversion: 2.1 time: 0.092725 Jun 03 13:09:49.879548 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 275/555] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:49 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 1464 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:49.925341 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-d40f9bc7-ee9c-4230-b0be-b935dc329d0d req-000386bf-1f9d-403f-9c50-4524b53f81e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e28701a-6711-4717-8c87-f0d3ea8058dd", "name": "network-vif-deleted", "tag": "ff9d5f88-c72e-4e8d-a891-5c0044136c8a"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:49.934605 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d40f9bc7-ee9c-4230-b0be-b935dc329d0d req-000386bf-1f9d-403f-9c50-4524b53f81e7 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:49.935091 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d40f9bc7-ee9c-4230-b0be-b935dc329d0d req-000386bf-1f9d-403f-9c50-4524b53f81e7 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:49.947472 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-d40f9bc7-ee9c-4230-b0be-b935dc329d0d req-000386bf-1f9d-403f-9c50-4524b53f81e7 service nova] Creating event network-vif-deleted:ff9d5f88-c72e-4e8d-a891-5c0044136c8a for instance 0e28701a-6711-4717-8c87-f0d3ea8058dd on hv-cinder-77954 Jun 03 13:09:49.953022 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-d40f9bc7-ee9c-4230-b0be-b935dc329d0d req-000386bf-1f9d-403f-9c50-4524b53f81e7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031257 Jun 03 13:09:49.953523 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 281/556] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:50.895371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6f60597a-6472-48df-9b2c-5f41559abe9c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:50.895987 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6f60597a-6472-48df-9b2c-5f41559abe9c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 0e28701a-6711-4717-8c87-f0d3ea8058dd] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:50.902942 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f60597a-6472-48df-9b2c-5f41559abe9c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:50.903415 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f60597a-6472-48df-9b2c-5f41559abe9c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:50.904185 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f60597a-6472-48df-9b2c-5f41559abe9c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:50.904622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6f60597a-6472-48df-9b2c-5f41559abe9c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:50.919918 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-6f60597a-6472-48df-9b2c-5f41559abe9c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] HTTP exception thrown: Instance 0e28701a-6711-4717-8c87-f0d3ea8058dd could not be found. Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6f60597a-6472-48df-9b2c-5f41559abe9c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Request method failure captured: Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd HTTP/1.1 Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgZb6OIAoFXauJTIaqiZtgkaDduvm40Tmnjoq76MT68LNhb3WKogFBe-eGYSp6zeb8cQNqB8O0IkSk2-MR9STml5Hwl6q8-MoxwD30LLRKESM7goJVvYLGOEIN6xysNErIWQyMbX0Xw6HJDjU3-WmLkhh9NSHZX5VfSX6Mgt9tOPOxQ Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 45170704be9845929be13eb3a96eeb07 Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:09:50.921549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:09:50.923169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45170704be9845929be13eb3a96eeb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45170704be9845929be13eb3a96eeb07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45170704be9845929be13eb3a96eeb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45170704be9845929be13eb3a96eeb07"}]}] Jun 03 13:09:50.923169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:09:50.923169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 45170704be9845929be13eb3a96eeb07 Jun 03 13:09:50.923169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:09:50.923169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-ServerRescueNegativeTestJSON-972257074-project Jun 03 13:09:50.923169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:09:50.923169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:09:50.923169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 010c4d5ba6b847b79d3127787db2ddd6 Jun 03 13:09:50.923169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-972257074-project Jun 03 13:09:50.923169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:09:50.923169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 0e28701a-6711-4717-8c87-f0d3ea8058dd could not be found. Jun 03 13:09:50.923169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '0e28701a-6711-4717-8c87-f0d3ea8058dd'} Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e28701a-6711-4717-8c87-f0d3ea8058dd could not be found. Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:09:50.924013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e28701a-6711-4717-8c87-f0d3ea8058dd could not be found. Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e28701a-6711-4717-8c87-f0d3ea8058dd could not be found. Jun 03 13:09:50.925454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:09:50.926783 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6f60597a-6472-48df-9b2c-5f41559abe9c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Returning 404 to user: Instance 0e28701a-6711-4717-8c87-f0d3ea8058dd could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:09:50.926783 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6f60597a-6472-48df-9b2c-5f41559abe9c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd" status: 404 len: 111 microversion: 2.1 time: 0.031734 Jun 03 13:09:50.926783 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 276/557] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:50 2022] GET /compute/v2.1/servers/0e28701a-6711-4717-8c87-f0d3ea8058dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:09:50.932487 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f3c40f34-7aed-4fe9-a3c9-b34d792b63aa tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:50.933072 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f3c40f34-7aed-4fe9-a3c9-b34d792b63aa tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:50.940095 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3c40f34-7aed-4fe9-a3c9-b34d792b63aa tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:50.940556 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3c40f34-7aed-4fe9-a3c9-b34d792b63aa tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:50.941338 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3c40f34-7aed-4fe9-a3c9-b34d792b63aa tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:50.941794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f3c40f34-7aed-4fe9-a3c9-b34d792b63aa tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:50.967836 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f3c40f34-7aed-4fe9-a3c9-b34d792b63aa tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:09:51.048762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f3c40f34-7aed-4fe9-a3c9-b34d792b63aa tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 204 len: 0 microversion: 2.1 time: 0.120318 Jun 03 13:09:51.049346 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 282/558] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:09:50 2022] DELETE /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:09:51.058458 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-19e92d22-b736-49ce-921b-b8376d1dab0c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:51.059058 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-19e92d22-b736-49ce-921b-b8376d1dab0c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:51.065188 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19e92d22-b736-49ce-921b-b8376d1dab0c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:51.065638 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19e92d22-b736-49ce-921b-b8376d1dab0c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:51.066468 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19e92d22-b736-49ce-921b-b8376d1dab0c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:51.066906 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-19e92d22-b736-49ce-921b-b8376d1dab0c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:51.209148 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-19e92d22-b736-49ce-921b-b8376d1dab0c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:51.217339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-19e92d22-b736-49ce-921b-b8376d1dab0c tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.163021 Jun 03 13:09:51.217910 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 277/559] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:51 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:52.237899 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-16a24674-3c97-46b4-9f27-110e6881c2af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:52.238940 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-16a24674-3c97-46b4-9f27-110e6881c2af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:52.249101 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-16a24674-3c97-46b4-9f27-110e6881c2af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:52.249705 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-16a24674-3c97-46b4-9f27-110e6881c2af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:52.250935 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-16a24674-3c97-46b4-9f27-110e6881c2af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:52.251424 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-16a24674-3c97-46b4-9f27-110e6881c2af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:52.393907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-16a24674-3c97-46b4-9f27-110e6881c2af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:52.401938 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-16a24674-3c97-46b4-9f27-110e6881c2af tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.170687 Jun 03 13:09:52.402524 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 283/560] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:52 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:53.419596 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9c4d509f-cbf5-44ef-aee8-3de48660b8c8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:53.420212 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9c4d509f-cbf5-44ef-aee8-3de48660b8c8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:53.426928 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9c4d509f-cbf5-44ef-aee8-3de48660b8c8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:53.427377 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9c4d509f-cbf5-44ef-aee8-3de48660b8c8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:53.428150 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9c4d509f-cbf5-44ef-aee8-3de48660b8c8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:53.428582 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9c4d509f-cbf5-44ef-aee8-3de48660b8c8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:53.511495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-7bff4988-1fea-4aca-a092-0d2b38f6bcff req-f8c783b9-7d5f-4212-a46b-1d12bcfd1f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8810fcf9-5763-45c2-9e84-9a12f2fa1447", "name": "network-vif-unplugged", "status": "completed", "tag": "f3140ed5-b3f5-4f50-a9f6-76f75f5506d6"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:53.516146 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:09:53.525037 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-7bff4988-1fea-4aca-a092-0d2b38f6bcff req-f8c783b9-7d5f-4212-a46b-1d12bcfd1f4b service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:53.526059 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-7bff4988-1fea-4aca-a092-0d2b38f6bcff req-f8c783b9-7d5f-4212-a46b-1d12bcfd1f4b service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:53.552305 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-7bff4988-1fea-4aca-a092-0d2b38f6bcff req-f8c783b9-7d5f-4212-a46b-1d12bcfd1f4b service nova] Creating event network-vif-unplugged:f3140ed5-b3f5-4f50-a9f6-76f75f5506d6 for instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 on hv-cinder-77954 Jun 03 13:09:53.558471 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-7bff4988-1fea-4aca-a092-0d2b38f6bcff req-f8c783b9-7d5f-4212-a46b-1d12bcfd1f4b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050577 Jun 03 13:09:53.559405 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 284/561] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:09:53.599836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9c4d509f-cbf5-44ef-aee8-3de48660b8c8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:53.611295 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9c4d509f-cbf5-44ef-aee8-3de48660b8c8 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1522 microversion: 2.1 time: 0.196252 Jun 03 13:09:53.611880 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 278/562] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:53 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:54.139023 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-991f40b7-8c89-4c41-a29b-2848d1644076 req-e5e2bbfd-7dcc-477a-acaa-5c4165e06ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8810fcf9-5763-45c2-9e84-9a12f2fa1447", "name": "network-vif-deleted", "tag": "f3140ed5-b3f5-4f50-a9f6-76f75f5506d6"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:09:54.149969 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-991f40b7-8c89-4c41-a29b-2848d1644076 req-e5e2bbfd-7dcc-477a-acaa-5c4165e06ea0 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:54.150525 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-991f40b7-8c89-4c41-a29b-2848d1644076 req-e5e2bbfd-7dcc-477a-acaa-5c4165e06ea0 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:54.162974 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-991f40b7-8c89-4c41-a29b-2848d1644076 req-e5e2bbfd-7dcc-477a-acaa-5c4165e06ea0 service nova] Creating event network-vif-deleted:f3140ed5-b3f5-4f50-a9f6-76f75f5506d6 for instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 on hv-cinder-77954 Jun 03 13:09:54.169336 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-991f40b7-8c89-4c41-a29b-2848d1644076 req-e5e2bbfd-7dcc-477a-acaa-5c4165e06ea0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034814 Jun 03 13:09:54.169935 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 285/563] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:09:54.629480 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c4de1e3d-cc8b-4fca-b08d-4e9e308664bb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:54.630090 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c4de1e3d-cc8b-4fca-b08d-4e9e308664bb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:54.637539 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4de1e3d-cc8b-4fca-b08d-4e9e308664bb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:54.637995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4de1e3d-cc8b-4fca-b08d-4e9e308664bb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:54.638800 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4de1e3d-cc8b-4fca-b08d-4e9e308664bb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:54.639233 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4de1e3d-cc8b-4fca-b08d-4e9e308664bb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:54.675725 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4de1e3d-cc8b-4fca-b08d-4e9e308664bb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:54.676418 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c4de1e3d-cc8b-4fca-b08d-4e9e308664bb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:54.676871 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-c4de1e3d-cc8b-4fca-b08d-4e9e308664bb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lazy-loading 'fault' on Instance uuid 8810fcf9-5763-45c2-9e84-9a12f2fa1447 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:09:54.718866 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c4de1e3d-cc8b-4fca-b08d-4e9e308664bb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '010c4d5ba6b847b79d3127787db2ddd6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45170704be9845929be13eb3a96eeb07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:09:54.725678 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c4de1e3d-cc8b-4fca-b08d-4e9e308664bb tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 200 len: 1312 microversion: 2.1 time: 0.100116 Jun 03 13:09:54.726231 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 279/564] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:54 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:09:55.745075 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f0535d80-1913-4b2d-bd72-d22c2ef7dba0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:09:55.745797 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f0535d80-1913-4b2d-bd72-d22c2ef7dba0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] [instance: 8810fcf9-5763-45c2-9e84-9a12f2fa1447] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:09:55.753338 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0535d80-1913-4b2d-bd72-d22c2ef7dba0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:55.753808 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0535d80-1913-4b2d-bd72-d22c2ef7dba0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:55.754652 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0535d80-1913-4b2d-bd72-d22c2ef7dba0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:09:55.755105 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0535d80-1913-4b2d-bd72-d22c2ef7dba0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:09:55.773998 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-f0535d80-1913-4b2d-bd72-d22c2ef7dba0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] HTTP exception thrown: Instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 could not be found. Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f0535d80-1913-4b2d-bd72-d22c2ef7dba0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Request method failure captured: Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 HTTP/1.1 Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZb6OIAoFXauJTIaqiZtgkaDduvm40Tmnjoq76MT68LNhb3WKogFBe-eGYSp6zeb8cQNqB8O0IkSk2-MR9STml5Hwl6q8-MoxwD30LLRKESM7goJVvYLGOEIN6xysNErIWQyMbX0Xw6HJDjU3-WmLkhh9NSHZX5VfSX6Mgt9tOPOxQ Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 45170704be9845929be13eb3a96eeb07 Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:09:55.776335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:09:55.777736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45170704be9845929be13eb3a96eeb07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_45170704be9845929be13eb3a96eeb07"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/45170704be9845929be13eb3a96eeb07"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/45170704be9845929be13eb3a96eeb07"}]}] Jun 03 13:09:55.777736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:09:55.777736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 45170704be9845929be13eb3a96eeb07 Jun 03 13:09:55.777736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-972257074 Jun 03 13:09:55.777736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-ServerRescueNegativeTestJSON-972257074-project Jun 03 13:09:55.777736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:09:55.777736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:09:55.777736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 010c4d5ba6b847b79d3127787db2ddd6 Jun 03 13:09:55.777736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-972257074-project Jun 03 13:09:55.777736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:09:55.777736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 could not be found. Jun 03 13:09:55.777736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '8810fcf9-5763-45c2-9e84-9a12f2fa1447'} Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 could not be found. Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:09:55.778538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 could not be found. Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 could not be found. Jun 03 13:09:55.779855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:09:55.781070 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f0535d80-1913-4b2d-bd72-d22c2ef7dba0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] Returning 404 to user: Instance 8810fcf9-5763-45c2-9e84-9a12f2fa1447 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:09:55.781070 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f0535d80-1913-4b2d-bd72-d22c2ef7dba0 tempest-ServerRescueNegativeTestJSON-972257074 tempest-ServerRescueNegativeTestJSON-972257074-project] 10.222.0.58 "GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447" status: 404 len: 111 microversion: 2.1 time: 0.037603 Jun 03 13:09:55.781070 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 286/565] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:09:55 2022] GET /compute/v2.1/servers/8810fcf9-5763-45c2-9e84-9a12f2fa1447 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:10:04.426701 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fba1796b-a22c-49a6-9941-52ee6a317cec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Action: 'create', calling method: .version_select at 0x7fc5a4202160>, body: {"keypair": {"name": "tempest-keypair-147115609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1LZcx2L33DadbZtZ6mijDZzg4AcRhA8cbOZNzlV5rFzEk1S7/oc2tSl/YzkzpeHlWS+/nm6LboE08W0O8Efa6X4hanH7q7f8Qct0og4C0OgELvzoLUG0ZllFDOXBcJyA=="}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:10:04.430812 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:10:04.443730 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-fba1796b-a22c-49a6-9941-52ee6a317cec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Getting quotas for project 020ed9813c614d2eae9568ba85728136. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:10:04.448208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-fba1796b-a22c-49a6-9941-52ee6a317cec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Getting quotas for user 49b596abb9a5466595eec1a8fb25d5a1 and project 020ed9813c614d2eae9568ba85728136. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:10:04.474048 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fba1796b-a22c-49a6-9941-52ee6a317cec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.169894 Jun 03 13:10:04.474698 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 280/566] 10.222.0.58 () {62 vars in 1199 bytes} [Fri Jun 3 13:10:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 13:10:05.811142 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1181734961", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56b39612-cd1c-430f-8391-8e3320755ed0"}], "security_groups": [{"name": "tempest-securitygroup--1075126244"}], "key_name": "tempest-keypair-147115609", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:10:05.818456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=5 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:10:05.819276 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:10:05.920849 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] validate_networks() for [('56b39612-cd1c-430f-8391-8e3320755ed0', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:10:06.588347 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:10:06.588772 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:10:06.589245 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:10:06.589683 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:10:06.590180 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:10:06.599751 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:06.600187 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:06.600987 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:06.601424 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:06.618214 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Getting quotas for project 020ed9813c614d2eae9568ba85728136. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:10:06.622758 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Getting quotas for user 49b596abb9a5466595eec1a8fb25d5a1 and project 020ed9813c614d2eae9568ba85728136. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:10:06.633938 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:10:06.636262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:10:06.684742 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d7238450-a727-4438-a803-64b6ff1608e6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.877995 Jun 03 13:10:06.685398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 287/567] 10.222.0.58 () {62 vars in 1187 bytes} [Fri Jun 3 13:10:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 13:10:06.692496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:10:06.697967 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3847f3b2-c957-4f21-8113-5dfad0d1acf8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:06.698620 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3847f3b2-c957-4f21-8113-5dfad0d1acf8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:06.769122 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3847f3b2-c957-4f21-8113-5dfad0d1acf8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:06.777570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3847f3b2-c957-4f21-8113-5dfad0d1acf8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:06.779128 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3847f3b2-c957-4f21-8113-5dfad0d1acf8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:06.780270 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3847f3b2-c957-4f21-8113-5dfad0d1acf8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1281 microversion: 2.20 time: 0.088526 Jun 03 13:10:06.780837 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 281/568] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:10:06 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:10:07.799340 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b57d58a8-bac6-4eb7-81cd-b6cfe26834b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:07.800603 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b57d58a8-bac6-4eb7-81cd-b6cfe26834b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:07.811388 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b57d58a8-bac6-4eb7-81cd-b6cfe26834b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:07.811834 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b57d58a8-bac6-4eb7-81cd-b6cfe26834b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:07.812614 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b57d58a8-bac6-4eb7-81cd-b6cfe26834b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:07.813053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b57d58a8-bac6-4eb7-81cd-b6cfe26834b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:07.890037 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b57d58a8-bac6-4eb7-81cd-b6cfe26834b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:07.899355 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b57d58a8-bac6-4eb7-81cd-b6cfe26834b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:07.900900 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b57d58a8-bac6-4eb7-81cd-b6cfe26834b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:07.902145 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b57d58a8-bac6-4eb7-81cd-b6cfe26834b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1339 microversion: 2.20 time: 0.107532 Jun 03 13:10:07.902939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 288/569] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:10:07 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1339 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:10:08.921076 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-491a06bb-2265-47cf-8c05-ec82afc72c22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:08.921684 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-491a06bb-2265-47cf-8c05-ec82afc72c22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:08.928537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-491a06bb-2265-47cf-8c05-ec82afc72c22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:08.928999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-491a06bb-2265-47cf-8c05-ec82afc72c22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:08.929759 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-491a06bb-2265-47cf-8c05-ec82afc72c22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:08.930214 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-491a06bb-2265-47cf-8c05-ec82afc72c22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:09.063538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-491a06bb-2265-47cf-8c05-ec82afc72c22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:09.072008 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-491a06bb-2265-47cf-8c05-ec82afc72c22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:09.073502 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-491a06bb-2265-47cf-8c05-ec82afc72c22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:09.075299 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-491a06bb-2265-47cf-8c05-ec82afc72c22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1407 microversion: 2.20 time: 0.157672 Jun 03 13:10:09.075852 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 282/570] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:10:08 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:10:09.374157 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-303fc952-bac4-4f39-9561-a8793df5752b req-ef7730f5-9811-4ab5-b3e0-565ceeab68bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0321187a-23dc-4d94-a1d1-e341d8fdf035", "tag": "1fae557f-ecd4-4f44-ad00-3f1f17914ef1"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:10:09.384647 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-303fc952-bac4-4f39-9561-a8793df5752b req-ef7730f5-9811-4ab5-b3e0-565ceeab68bd service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:09.387204 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-303fc952-bac4-4f39-9561-a8793df5752b req-ef7730f5-9811-4ab5-b3e0-565ceeab68bd service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:09.400327 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-303fc952-bac4-4f39-9561-a8793df5752b req-ef7730f5-9811-4ab5-b3e0-565ceeab68bd service nova] Creating event network-changed:1fae557f-ecd4-4f44-ad00-3f1f17914ef1 for instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 on hv-cinder-77954 Jun 03 13:10:09.405486 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-303fc952-bac4-4f39-9561-a8793df5752b req-ef7730f5-9811-4ab5-b3e0-565ceeab68bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035219 Jun 03 13:10:09.406423 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 289/571] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:10:10.097526 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f2fd3803-1ec8-477b-84f8-9ffa29e97db6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:10.098504 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f2fd3803-1ec8-477b-84f8-9ffa29e97db6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:10.108160 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f2fd3803-1ec8-477b-84f8-9ffa29e97db6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:10.108629 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f2fd3803-1ec8-477b-84f8-9ffa29e97db6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:10.109401 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f2fd3803-1ec8-477b-84f8-9ffa29e97db6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:10.109846 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f2fd3803-1ec8-477b-84f8-9ffa29e97db6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:10.249967 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f2fd3803-1ec8-477b-84f8-9ffa29e97db6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:10.258725 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f2fd3803-1ec8-477b-84f8-9ffa29e97db6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:10.260226 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f2fd3803-1ec8-477b-84f8-9ffa29e97db6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:10.261367 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f2fd3803-1ec8-477b-84f8-9ffa29e97db6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1407 microversion: 2.20 time: 0.170625 Jun 03 13:10:10.262040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 283/572] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:10:10 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:10:11.285132 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ddba55c6-e9d5-4803-867a-4f6322f9c997 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:11.286272 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ddba55c6-e9d5-4803-867a-4f6322f9c997 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:11.296925 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ddba55c6-e9d5-4803-867a-4f6322f9c997 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:11.297661 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ddba55c6-e9d5-4803-867a-4f6322f9c997 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:11.298980 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ddba55c6-e9d5-4803-867a-4f6322f9c997 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:11.299695 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ddba55c6-e9d5-4803-867a-4f6322f9c997 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:11.437657 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ddba55c6-e9d5-4803-867a-4f6322f9c997 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:11.445918 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ddba55c6-e9d5-4803-867a-4f6322f9c997 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:11.447492 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ddba55c6-e9d5-4803-867a-4f6322f9c997 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:11.448638 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ddba55c6-e9d5-4803-867a-4f6322f9c997 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1407 microversion: 2.20 time: 0.171536 Jun 03 13:10:11.449228 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 290/573] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:10:11 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:10:12.467095 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2e7f2020-a3f2-4781-8261-c1a843ccd8e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:12.467783 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2e7f2020-a3f2-4781-8261-c1a843ccd8e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:12.474758 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e7f2020-a3f2-4781-8261-c1a843ccd8e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:12.475205 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e7f2020-a3f2-4781-8261-c1a843ccd8e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:12.475972 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e7f2020-a3f2-4781-8261-c1a843ccd8e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:12.476400 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e7f2020-a3f2-4781-8261-c1a843ccd8e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:12.611933 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2e7f2020-a3f2-4781-8261-c1a843ccd8e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:12.624590 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2e7f2020-a3f2-4781-8261-c1a843ccd8e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:12.627023 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2e7f2020-a3f2-4781-8261-c1a843ccd8e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:12.628716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2e7f2020-a3f2-4781-8261-c1a843ccd8e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1407 microversion: 2.20 time: 0.165378 Jun 03 13:10:12.629512 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 284/574] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:10:12 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:10:13.650279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6bd7876a-193e-4ddf-8d63-6cd0478a3c8f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:13.650907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6bd7876a-193e-4ddf-8d63-6cd0478a3c8f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:13.657693 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6bd7876a-193e-4ddf-8d63-6cd0478a3c8f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:13.658470 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6bd7876a-193e-4ddf-8d63-6cd0478a3c8f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:13.658992 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6bd7876a-193e-4ddf-8d63-6cd0478a3c8f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:13.659596 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6bd7876a-193e-4ddf-8d63-6cd0478a3c8f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:13.800965 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6bd7876a-193e-4ddf-8d63-6cd0478a3c8f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:13.809749 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6bd7876a-193e-4ddf-8d63-6cd0478a3c8f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:13.811363 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6bd7876a-193e-4ddf-8d63-6cd0478a3c8f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:13.812533 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6bd7876a-193e-4ddf-8d63-6cd0478a3c8f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1407 microversion: 2.20 time: 0.166256 Jun 03 13:10:13.813075 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 291/575] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:10:13 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:10:14.836018 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d37c7450-e1cd-4a0d-86ae-a58832747e66 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:14.836973 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d37c7450-e1cd-4a0d-86ae-a58832747e66 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:14.848548 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d37c7450-e1cd-4a0d-86ae-a58832747e66 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:14.848884 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d37c7450-e1cd-4a0d-86ae-a58832747e66 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:14.850256 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d37c7450-e1cd-4a0d-86ae-a58832747e66 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:14.851026 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d37c7450-e1cd-4a0d-86ae-a58832747e66 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:14.984132 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d37c7450-e1cd-4a0d-86ae-a58832747e66 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:14.992846 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d37c7450-e1cd-4a0d-86ae-a58832747e66 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:14.994383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d37c7450-e1cd-4a0d-86ae-a58832747e66 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:14.995501 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d37c7450-e1cd-4a0d-86ae-a58832747e66 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1407 microversion: 2.20 time: 0.166324 Jun 03 13:10:14.996085 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 285/576] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:10:14 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:10:15.600353 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-07c94f5c-fdc1-48e6-abc4-e205d8aaf711 req-9e253d3b-9cc2-473e-a4f7-77a8732bfbdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0321187a-23dc-4d94-a1d1-e341d8fdf035", "name": "network-vif-plugged", "status": "completed", "tag": "1fae557f-ecd4-4f44-ad00-3f1f17914ef1"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:10:15.609650 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-07c94f5c-fdc1-48e6-abc4-e205d8aaf711 req-9e253d3b-9cc2-473e-a4f7-77a8732bfbdb service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:15.610204 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-07c94f5c-fdc1-48e6-abc4-e205d8aaf711 req-9e253d3b-9cc2-473e-a4f7-77a8732bfbdb service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:15.622170 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-07c94f5c-fdc1-48e6-abc4-e205d8aaf711 req-9e253d3b-9cc2-473e-a4f7-77a8732bfbdb service nova] Creating event network-vif-plugged:1fae557f-ecd4-4f44-ad00-3f1f17914ef1 for instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 on hv-cinder-77954 Jun 03 13:10:15.627162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-07c94f5c-fdc1-48e6-abc4-e205d8aaf711 req-9e253d3b-9cc2-473e-a4f7-77a8732bfbdb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030586 Jun 03 13:10:15.627778 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 292/577] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:10:16.021486 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8ce29577-03b1-4a06-8d5f-9ac879e75e22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:16.022265 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8ce29577-03b1-4a06-8d5f-9ac879e75e22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:16.032244 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ce29577-03b1-4a06-8d5f-9ac879e75e22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:16.032899 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ce29577-03b1-4a06-8d5f-9ac879e75e22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:16.033918 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ce29577-03b1-4a06-8d5f-9ac879e75e22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:16.034600 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ce29577-03b1-4a06-8d5f-9ac879e75e22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:16.174674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8ce29577-03b1-4a06-8d5f-9ac879e75e22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:16.184492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8ce29577-03b1-4a06-8d5f-9ac879e75e22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:16.186076 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8ce29577-03b1-4a06-8d5f-9ac879e75e22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:16.187231 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8ce29577-03b1-4a06-8d5f-9ac879e75e22 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1407 microversion: 2.20 time: 0.171219 Jun 03 13:10:16.187832 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 286/578] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:10:16 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:10:17.205151 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:10:17.205926 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:10:17.212142 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4079670c-1c5a-488d-928e-6c9025dfce19 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:17.213083 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4079670c-1c5a-488d-928e-6c9025dfce19 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:17.221226 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4079670c-1c5a-488d-928e-6c9025dfce19 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:17.221681 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4079670c-1c5a-488d-928e-6c9025dfce19 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:17.222538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4079670c-1c5a-488d-928e-6c9025dfce19 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:17.222978 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4079670c-1c5a-488d-928e-6c9025dfce19 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:17.359415 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4079670c-1c5a-488d-928e-6c9025dfce19 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:17.372041 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4079670c-1c5a-488d-928e-6c9025dfce19 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:17.373564 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4079670c-1c5a-488d-928e-6c9025dfce19 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:17.374699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4079670c-1c5a-488d-928e-6c9025dfce19 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1407 microversion: 2.20 time: 0.172165 Jun 03 13:10:17.375257 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 293/579] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:10:17 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:10:18.397396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cbb4a18f-2dc9-425f-8d86-dc1639954cfe tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:18.398899 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cbb4a18f-2dc9-425f-8d86-dc1639954cfe tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:18.402169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:10:18.413405 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cbb4a18f-2dc9-425f-8d86-dc1639954cfe tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:18.414174 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cbb4a18f-2dc9-425f-8d86-dc1639954cfe tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:18.415496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cbb4a18f-2dc9-425f-8d86-dc1639954cfe tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:18.416228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cbb4a18f-2dc9-425f-8d86-dc1639954cfe tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:18.559894 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cbb4a18f-2dc9-425f-8d86-dc1639954cfe tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:18.568407 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cbb4a18f-2dc9-425f-8d86-dc1639954cfe tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:18.569912 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cbb4a18f-2dc9-425f-8d86-dc1639954cfe tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:18.571109 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cbb4a18f-2dc9-425f-8d86-dc1639954cfe tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1598 microversion: 2.20 time: 0.180876 Jun 03 13:10:18.571680 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 287/580] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:10:18 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1598 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:10:18.589190 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a69e0887-0d9f-4bba-ab0e-6391a45e1eb9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:18.589804 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a69e0887-0d9f-4bba-ab0e-6391a45e1eb9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:18.596717 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a69e0887-0d9f-4bba-ab0e-6391a45e1eb9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:18.597131 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a69e0887-0d9f-4bba-ab0e-6391a45e1eb9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:18.597933 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a69e0887-0d9f-4bba-ab0e-6391a45e1eb9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:18.598430 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a69e0887-0d9f-4bba-ab0e-6391a45e1eb9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:18.679899 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a69e0887-0d9f-4bba-ab0e-6391a45e1eb9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094604 Jun 03 13:10:18.680503 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 294/581] 10.222.0.58 () {60 vars in 1315 bytes} [Fri Jun 3 13:10:18 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 13:10:19.624222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-7eaf04f2-6121-411c-8db3-642018d2f8ed req-b4a7af4e-2c27-4b99-9957-d8e3e97c1d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0321187a-23dc-4d94-a1d1-e341d8fdf035", "tag": "1fae557f-ecd4-4f44-ad00-3f1f17914ef1"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:10:19.632680 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-7eaf04f2-6121-411c-8db3-642018d2f8ed req-b4a7af4e-2c27-4b99-9957-d8e3e97c1d06 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:19.633131 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-7eaf04f2-6121-411c-8db3-642018d2f8ed req-b4a7af4e-2c27-4b99-9957-d8e3e97c1d06 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:19.644182 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-7eaf04f2-6121-411c-8db3-642018d2f8ed req-b4a7af4e-2c27-4b99-9957-d8e3e97c1d06 service nova] Creating event network-changed:1fae557f-ecd4-4f44-ad00-3f1f17914ef1 for instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 on hv-cinder-77954 Jun 03 13:10:19.649204 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-7eaf04f2-6121-411c-8db3-642018d2f8ed req-b4a7af4e-2c27-4b99-9957-d8e3e97c1d06 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029490 Jun 03 13:10:19.649778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 288/582] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:10:47.752666 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:10:47.753990 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=34 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:10:47.759032 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-091bd1a8-53f0-4f83-b048-64ef7fd716dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:47.759541 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-091bd1a8-53f0-4f83-b048-64ef7fd716dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:47.767181 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-091bd1a8-53f0-4f83-b048-64ef7fd716dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:47.767642 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-091bd1a8-53f0-4f83-b048-64ef7fd716dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:47.768441 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-091bd1a8-53f0-4f83-b048-64ef7fd716dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:47.768888 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-091bd1a8-53f0-4f83-b048-64ef7fd716dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:47.795312 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-091bd1a8-53f0-4f83-b048-64ef7fd716dc tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/ips" status: 200 len: 149 microversion: 2.1 time: 0.045176 Jun 03 13:10:47.795870 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 295/583] 10.222.0.58 () {58 vars in 1247 bytes} [Fri Jun 3 13:10:47 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:10:49.135910 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:10:49.136773 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=38 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:10:49.142150 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0517613c-f430-4091-b24a-c64615ad9693 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e42978ff-8c99-4dca-9126-ad92cbf54ea2"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:10:49.143909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0517613c-f430-4091-b24a-c64615ad9693 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:49.154982 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0517613c-f430-4091-b24a-c64615ad9693 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:49.155662 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0517613c-f430-4091-b24a-c64615ad9693 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:49.156753 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0517613c-f430-4091-b24a-c64615ad9693 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:49.157363 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0517613c-f430-4091-b24a-c64615ad9693 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:49.406397 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0517613c-f430-4091-b24a-c64615ad9693 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272860 Jun 03 13:10:49.407022 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 289/584] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:10:49 2022] POST /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:10:56.971693 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-97409d26-ca6c-44bb-8668-82419d9ee384 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e42978ff-8c99-4dca-9126-ad92cbf54ea2"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:10:56.972761 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-97409d26-ca6c-44bb-8668-82419d9ee384 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:56.979277 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97409d26-ca6c-44bb-8668-82419d9ee384 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:56.979728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97409d26-ca6c-44bb-8668-82419d9ee384 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:56.980490 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97409d26-ca6c-44bb-8668-82419d9ee384 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:56.980921 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-97409d26-ca6c-44bb-8668-82419d9ee384 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:57.073382 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-97409d26-ca6c-44bb-8668-82419d9ee384 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Invalid volume: volume e42978ff-8c99-4dca-9126-ad92cbf54ea2 is already attached to instances: 328fcefb-287f-49d4-b35e-69edc918861e Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-97409d26-ca6c-44bb-8668-82419d9ee384 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: POST /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-volume_attachments HTTP/1.1 Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 74 Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:10:57.075136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:10:57.076768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:10:57.076768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:10:57.076768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:10:57.076768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:10:57.076768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:10:57.076768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:10:57.076768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:10:57.076768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:10:57.076768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:10:57.076768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Jun 03 13:10:57.076768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {"volumeAttachment": {"volumeId": "e42978ff-8c99-4dca-9126-ad92cbf54ea2"}} Jun 03 13:10:57.076768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Invalid volume: volume e42978ff-8c99-4dca-9126-ad92cbf54ea2 is already attached to instances: 328fcefb-287f-49d4-b35e-69edc918861e Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'server_id': '328fcefb-287f-49d4-b35e-69edc918861e', 'body': {'volumeAttachment': {'volumeId': 'e42978ff-8c99-4dca-9126-ad92cbf54ea2'}}} Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e42978ff-8c99-4dca-9126-ad92cbf54ea2 is already attached to instances: 328fcefb-287f-49d4-b35e-69edc918861e Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:10:57.077655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e42978ff-8c99-4dca-9126-ad92cbf54ea2 is already attached to instances: 328fcefb-287f-49d4-b35e-69edc918861e Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:10:57.079096 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:10:57.080636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:10:57.080636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:10:57.080636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:10:57.080636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e42978ff-8c99-4dca-9126-ad92cbf54ea2 is already attached to instances: 328fcefb-287f-49d4-b35e-69edc918861e Jun 03 13:10:57.080636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:10:57.080636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-97409d26-ca6c-44bb-8668-82419d9ee384 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 400 to user: Invalid volume: volume e42978ff-8c99-4dca-9126-ad92cbf54ea2 is already attached to instances: 328fcefb-287f-49d4-b35e-69edc918861e {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:10:57.080636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-97409d26-ca6c-44bb-8668-82419d9ee384 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109231 Jun 03 13:10:57.080636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 296/585] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:10:56 2022] POST /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:10:57.138954 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-72196382-38ea-4ee0-aa72-fd290b4c870a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:57.139508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-72196382-38ea-4ee0-aa72-fd290b4c870a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:57.146224 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72196382-38ea-4ee0-aa72-fd290b4c870a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:57.146677 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72196382-38ea-4ee0-aa72-fd290b4c870a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:57.147451 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72196382-38ea-4ee0-aa72-fd290b4c870a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:57.147892 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72196382-38ea-4ee0-aa72-fd290b4c870a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:57.237512 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-72196382-38ea-4ee0-aa72-fd290b4c870a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lazy-loading 'services' on Instance uuid 328fcefb-287f-49d4-b35e-69edc918861e {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:10:57.315667 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-72196382-38ea-4ee0-aa72-fd290b4c870a tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-volume_attachments/e42978ff-8c99-4dca-9126-ad92cbf54ea2" status: 202 len: 0 microversion: 2.1 time: 0.181462 Jun 03 13:10:57.316267 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 290/586] 10.222.0.58 () {58 vars in 1415 bytes} [Fri Jun 3 13:10:57 2022] DELETE /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-volume_attachments/e42978ff-8c99-4dca-9126-ad92cbf54ea2 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:10:57.325501 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bf3c395d-b1f0-46fa-8398-b49187d90f7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:57.326479 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bf3c395d-b1f0-46fa-8398-b49187d90f7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:57.332582 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf3c395d-b1f0-46fa-8398-b49187d90f7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:57.333027 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf3c395d-b1f0-46fa-8398-b49187d90f7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:57.333854 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf3c395d-b1f0-46fa-8398-b49187d90f7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:57.334399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf3c395d-b1f0-46fa-8398-b49187d90f7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:57.368345 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bf3c395d-b1f0-46fa-8398-b49187d90f7e tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046888 Jun 03 13:10:57.368947 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 297/587] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:10:57 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:10:58.386386 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cdc43de8-e7ba-411a-a7d9-139dc649dce7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:58.388119 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cdc43de8-e7ba-411a-a7d9-139dc649dce7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:58.399770 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cdc43de8-e7ba-411a-a7d9-139dc649dce7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:58.400448 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cdc43de8-e7ba-411a-a7d9-139dc649dce7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:58.401276 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cdc43de8-e7ba-411a-a7d9-139dc649dce7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:58.401731 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cdc43de8-e7ba-411a-a7d9-139dc649dce7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:58.432811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cdc43de8-e7ba-411a-a7d9-139dc649dce7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053702 Jun 03 13:10:58.433392 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 291/588] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:10:58 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:10:58.490397 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-af72d821-0649-4327-956b-a2b996792ab6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:58.490919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-af72d821-0649-4327-956b-a2b996792ab6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:58.498442 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-af72d821-0649-4327-956b-a2b996792ab6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:58.498897 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-af72d821-0649-4327-956b-a2b996792ab6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:58.499710 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-af72d821-0649-4327-956b-a2b996792ab6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:58.500151 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-af72d821-0649-4327-956b-a2b996792ab6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:58.525670 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-af72d821-0649-4327-956b-a2b996792ab6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:10:58.608431 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-af72d821-0649-4327-956b-a2b996792ab6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 204 len: 0 microversion: 2.1 time: 0.122157 Jun 03 13:10:58.609035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 298/589] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:10:58 2022] DELETE /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:10:58.617731 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9ec08ca5-7e9f-4ca7-a879-5b689d9c26f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:58.618386 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9ec08ca5-7e9f-4ca7-a879-5b689d9c26f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:58.624472 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ec08ca5-7e9f-4ca7-a879-5b689d9c26f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:58.624953 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ec08ca5-7e9f-4ca7-a879-5b689d9c26f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:58.625786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ec08ca5-7e9f-4ca7-a879-5b689d9c26f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:58.626191 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ec08ca5-7e9f-4ca7-a879-5b689d9c26f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:58.758392 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9ec08ca5-7e9f-4ca7-a879-5b689d9c26f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:58.766531 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9ec08ca5-7e9f-4ca7-a879-5b689d9c26f9 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1679 microversion: 2.1 time: 0.152984 Jun 03 13:10:58.767129 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 292/590] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:10:58 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:10:59.789177 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-75ea6c22-1ff7-4e6a-a511-8bab9334f1ae tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:10:59.790353 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-75ea6c22-1ff7-4e6a-a511-8bab9334f1ae tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:10:59.801499 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75ea6c22-1ff7-4e6a-a511-8bab9334f1ae tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:59.802177 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75ea6c22-1ff7-4e6a-a511-8bab9334f1ae tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:59.803455 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75ea6c22-1ff7-4e6a-a511-8bab9334f1ae tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:10:59.804171 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75ea6c22-1ff7-4e6a-a511-8bab9334f1ae tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:10:59.952115 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-75ea6c22-1ff7-4e6a-a511-8bab9334f1ae tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:10:59.960431 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-75ea6c22-1ff7-4e6a-a511-8bab9334f1ae tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1679 microversion: 2.1 time: 0.178501 Jun 03 13:10:59.960997 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 299/591] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:10:59 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:00.976936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bd205f97-4826-418c-92de-cd5e5e675bc8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:00.977659 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bd205f97-4826-418c-92de-cd5e5e675bc8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:00.984527 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd205f97-4826-418c-92de-cd5e5e675bc8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:00.984972 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd205f97-4826-418c-92de-cd5e5e675bc8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:00.985736 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd205f97-4826-418c-92de-cd5e5e675bc8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:00.986196 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bd205f97-4826-418c-92de-cd5e5e675bc8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:01.052982 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bd205f97-4826-418c-92de-cd5e5e675bc8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:01.060955 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bd205f97-4826-418c-92de-cd5e5e675bc8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1612 microversion: 2.1 time: 0.087957 Jun 03 13:11:01.061546 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 293/592] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:00 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1612 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:01.549922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-e8338489-4954-424d-b249-416a7105e977 req-647fe838-b818-473a-b04c-1919cbf23d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328fcefb-287f-49d4-b35e-69edc918861e", "name": "network-vif-deleted", "tag": "a578e8b6-9a30-47ce-b1fe-e7159b737a6b"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:11:01.561207 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-e8338489-4954-424d-b249-416a7105e977 req-647fe838-b818-473a-b04c-1919cbf23d37 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:01.561751 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-e8338489-4954-424d-b249-416a7105e977 req-647fe838-b818-473a-b04c-1919cbf23d37 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:01.584773 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-e8338489-4954-424d-b249-416a7105e977 req-647fe838-b818-473a-b04c-1919cbf23d37 service nova] Creating event network-vif-deleted:a578e8b6-9a30-47ce-b1fe-e7159b737a6b for instance 328fcefb-287f-49d4-b35e-69edc918861e on hv-cinder-77954 Jun 03 13:11:01.590903 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-e8338489-4954-424d-b249-416a7105e977 req-647fe838-b818-473a-b04c-1919cbf23d37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043893 Jun 03 13:11:01.590903 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 300/593] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:11:02.078820 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-736d15d0-6b8f-40d9-8555-1e5e17b68e22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:02.079482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-736d15d0-6b8f-40d9-8555-1e5e17b68e22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:02.086597 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-736d15d0-6b8f-40d9-8555-1e5e17b68e22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:02.087057 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-736d15d0-6b8f-40d9-8555-1e5e17b68e22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:02.087834 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-736d15d0-6b8f-40d9-8555-1e5e17b68e22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:02.088314 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-736d15d0-6b8f-40d9-8555-1e5e17b68e22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:02.120327 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-736d15d0-6b8f-40d9-8555-1e5e17b68e22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:02.120773 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-736d15d0-6b8f-40d9-8555-1e5e17b68e22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:02.121346 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-736d15d0-6b8f-40d9-8555-1e5e17b68e22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lazy-loading 'fault' on Instance uuid 328fcefb-287f-49d4-b35e-69edc918861e {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:11:02.165064 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-736d15d0-6b8f-40d9-8555-1e5e17b68e22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:02.173149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-736d15d0-6b8f-40d9-8555-1e5e17b68e22 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 200 len: 1330 microversion: 2.1 time: 0.098310 Jun 03 13:11:02.173737 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 294/594] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:02 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:03.193521 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e563ece1-b08b-4c31-b4b8-a880ee70c539 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:03.194264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e563ece1-b08b-4c31-b4b8-a880ee70c539 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:03.201462 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e563ece1-b08b-4c31-b4b8-a880ee70c539 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:03.201917 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e563ece1-b08b-4c31-b4b8-a880ee70c539 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:03.202746 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e563ece1-b08b-4c31-b4b8-a880ee70c539 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:03.203183 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e563ece1-b08b-4c31-b4b8-a880ee70c539 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:03.217333 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-e563ece1-b08b-4c31-b4b8-a880ee70c539 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e563ece1-b08b-4c31-b4b8-a880ee70c539 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e HTTP/1.1 Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:11:03.219618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:11:03.221317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:11:03.221317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:11:03.221317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:11:03.221317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:11:03.221317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:11:03.221317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:11:03.221317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:11:03.221317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:11:03.221317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:11:03.221317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:11:03.221317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:11:03.221317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '328fcefb-287f-49d4-b35e-69edc918861e'} Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:11:03.222562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:11:03.224124 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:11:03.225527 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e563ece1-b08b-4c31-b4b8-a880ee70c539 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 404 to user: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:11:03.225527 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e563ece1-b08b-4c31-b4b8-a880ee70c539 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 404 len: 111 microversion: 2.1 time: 0.032979 Jun 03 13:11:03.225527 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 301/595] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:03 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:11:03.232482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8b4996ca-b0fd-4c68-86aa-b0fbb7b765e3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '.version_select at 0x7fc5a4202dc0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:03.255046 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8b4996ca-b0fd-4c68-86aa-b0fbb7b765e3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864786495" status: 202 len: 0 microversion: 2.1 time: 0.027668 Jun 03 13:11:03.255620 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 295/596] 10.222.0.58 () {58 vars in 1217 bytes} [Fri Jun 3 13:11:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864786495 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:11:03.961965 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b65ff62b-b786-44d9-b7f6-8322916674a8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: .version_select at 0x7fc5a437c280>, body: {"keypair": {"name": "tempest-keypair-1693654086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfzy+QmZMK6OuzE78Xk/7+vl2NGUavaKo6ag80FY1L2E/2KXWew30NJQN+57DaZ7NCHwKASVAq9BLYwz4h+eycx38fZjq0IxI6pKx9UjNiKUUVknJ3nK6RFSjRXiZErTw=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:11:03.977688 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-b65ff62b-b786-44d9-b7f6-8322916674a8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:11:03.982516 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-b65ff62b-b786-44d9-b7f6-8322916674a8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for user f2217b3c134d453fbdcb14853eed4e3b and project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:11:04.009533 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b65ff62b-b786-44d9-b7f6-8322916674a8 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051491 Jun 03 13:11:04.010170 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 302/597] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Jun 3 13:11:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:11:05.432229 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1261696608", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d6f325b-d3a4-43a7-8d89-d0ffbb50df9b"}], "security_groups": [{"name": "tempest-securitygroup--841036208"}], "key_name": "tempest-keypair-1693654086", "user_data": "}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:11:05.544163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] validate_networks() for [('6d6f325b-d3a4-43a7-8d89-d0ffbb50df9b', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:11:05.939127 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:11:05.939644 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:11:05.940135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:11:05.940540 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:11:05.941100 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:11:05.953378 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:05.953853 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:05.954682 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:05.955113 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:05.972535 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:11:05.976831 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Getting quotas for user f2217b3c134d453fbdcb14853eed4e3b and project b6cc7be84d074c319f6c2d8628e76f52. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:11:05.988471 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:11:05.991095 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:11:06.050484 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-739bb1dd-4ee3-49e5-bba5-0cce399a816d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.623043 Jun 03 13:11:06.051402 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 296/598] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:11:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 13:11:06.062244 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-32979be2-5194-4c87-b83d-42631cfd3d83 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:06.062840 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-32979be2-5194-4c87-b83d-42631cfd3d83 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:06.119722 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-32979be2-5194-4c87-b83d-42631cfd3d83 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:06.126628 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-32979be2-5194-4c87-b83d-42631cfd3d83 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1242 microversion: 2.1 time: 0.068671 Jun 03 13:11:06.127169 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 303/599] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:06 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:07.143464 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-48872242-4b4b-4b9a-bc3b-1d070f9c3a55 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:07.144144 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-48872242-4b4b-4b9a-bc3b-1d070f9c3a55 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:07.150748 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48872242-4b4b-4b9a-bc3b-1d070f9c3a55 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:07.151296 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48872242-4b4b-4b9a-bc3b-1d070f9c3a55 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:07.152530 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48872242-4b4b-4b9a-bc3b-1d070f9c3a55 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:07.153956 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-48872242-4b4b-4b9a-bc3b-1d070f9c3a55 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:07.216828 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-48872242-4b4b-4b9a-bc3b-1d070f9c3a55 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:07.224991 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-48872242-4b4b-4b9a-bc3b-1d070f9c3a55 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1300 microversion: 2.1 time: 0.085904 Jun 03 13:11:07.225576 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 297/600] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:07 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:08.243255 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4c8f9282-5c5d-49e0-8575-17d1d6eb7228 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:08.243986 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4c8f9282-5c5d-49e0-8575-17d1d6eb7228 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:08.250843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c8f9282-5c5d-49e0-8575-17d1d6eb7228 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:08.251613 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c8f9282-5c5d-49e0-8575-17d1d6eb7228 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:08.252776 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c8f9282-5c5d-49e0-8575-17d1d6eb7228 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:08.253318 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4c8f9282-5c5d-49e0-8575-17d1d6eb7228 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:08.381788 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-aaf4c0a3-c8e0-4964-afa7-0ada6bab1f15 req-c55f615a-da60-4bfb-ae51-1dca7f91fa8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81458192-c1e4-464b-916a-dbba42252d64", "tag": "b0b7c562-0e9c-4a53-b571-448df6f49db9"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:11:08.393632 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-aaf4c0a3-c8e0-4964-afa7-0ada6bab1f15 req-c55f615a-da60-4bfb-ae51-1dca7f91fa8b service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:08.394274 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-aaf4c0a3-c8e0-4964-afa7-0ada6bab1f15 req-c55f615a-da60-4bfb-ae51-1dca7f91fa8b service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:08.409016 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-aaf4c0a3-c8e0-4964-afa7-0ada6bab1f15 req-c55f615a-da60-4bfb-ae51-1dca7f91fa8b service nova] Creating event network-changed:b0b7c562-0e9c-4a53-b571-448df6f49db9 for instance 81458192-c1e4-464b-916a-dbba42252d64 on hv-cinder-77954 Jun 03 13:11:08.428953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4c8f9282-5c5d-49e0-8575-17d1d6eb7228 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:08.433065 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-aaf4c0a3-c8e0-4964-afa7-0ada6bab1f15 req-c55f615a-da60-4bfb-ae51-1dca7f91fa8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058461 Jun 03 13:11:08.435204 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 298/601] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:11:08.438422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4c8f9282-5c5d-49e0-8575-17d1d6eb7228 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1367 microversion: 2.1 time: 0.199517 Jun 03 13:11:08.439410 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 304/602] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:08 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:09.459799 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b86da95a-08ce-40c2-b99f-dde472d5dd7c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:09.460686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b86da95a-08ce-40c2-b99f-dde472d5dd7c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:09.468636 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b86da95a-08ce-40c2-b99f-dde472d5dd7c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:09.469101 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b86da95a-08ce-40c2-b99f-dde472d5dd7c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:09.469871 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b86da95a-08ce-40c2-b99f-dde472d5dd7c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:09.470351 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b86da95a-08ce-40c2-b99f-dde472d5dd7c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:09.615739 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b86da95a-08ce-40c2-b99f-dde472d5dd7c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:09.625678 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b86da95a-08ce-40c2-b99f-dde472d5dd7c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1367 microversion: 2.1 time: 0.171823 Jun 03 13:11:09.626316 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 299/603] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:09 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:10.648177 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7b958ae4-f832-4106-9238-27a78a6d887b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:10.649142 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7b958ae4-f832-4106-9238-27a78a6d887b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:10.659700 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7b958ae4-f832-4106-9238-27a78a6d887b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:10.660381 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7b958ae4-f832-4106-9238-27a78a6d887b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:10.661557 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7b958ae4-f832-4106-9238-27a78a6d887b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:10.662273 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7b958ae4-f832-4106-9238-27a78a6d887b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:10.805656 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7b958ae4-f832-4106-9238-27a78a6d887b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:10.813315 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7b958ae4-f832-4106-9238-27a78a6d887b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1367 microversion: 2.1 time: 0.171359 Jun 03 13:11:10.813873 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 305/604] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:10 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:11.835655 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-73f99b14-b4d5-45e2-98c4-1ee91c4606f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:11.836229 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-73f99b14-b4d5-45e2-98c4-1ee91c4606f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:11.843445 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-73f99b14-b4d5-45e2-98c4-1ee91c4606f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:11.843888 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-73f99b14-b4d5-45e2-98c4-1ee91c4606f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:11.844655 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-73f99b14-b4d5-45e2-98c4-1ee91c4606f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:11.845180 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-73f99b14-b4d5-45e2-98c4-1ee91c4606f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:11.980674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-73f99b14-b4d5-45e2-98c4-1ee91c4606f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:11.988680 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-73f99b14-b4d5-45e2-98c4-1ee91c4606f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1367 microversion: 2.1 time: 0.156805 Jun 03 13:11:11.989152 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 300/605] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:11 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:13.010712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ee8a226b-e7c8-4616-937b-1cf67eb745c3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:13.011693 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ee8a226b-e7c8-4616-937b-1cf67eb745c3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:13.022681 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee8a226b-e7c8-4616-937b-1cf67eb745c3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:13.023442 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee8a226b-e7c8-4616-937b-1cf67eb745c3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:13.024732 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee8a226b-e7c8-4616-937b-1cf67eb745c3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:13.025461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ee8a226b-e7c8-4616-937b-1cf67eb745c3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:13.169297 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ee8a226b-e7c8-4616-937b-1cf67eb745c3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:13.180772 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ee8a226b-e7c8-4616-937b-1cf67eb745c3 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1367 microversion: 2.1 time: 0.176459 Jun 03 13:11:13.181547 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 306/606] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:13 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:13.904654 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-c694df4c-2934-49b7-bc8b-7b62437a3258 req-e9a5359e-9f2d-4a8a-912a-c5f74bdf20b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81458192-c1e4-464b-916a-dbba42252d64", "name": "network-vif-plugged", "status": "completed", "tag": "b0b7c562-0e9c-4a53-b571-448df6f49db9"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:11:13.913409 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-c694df4c-2934-49b7-bc8b-7b62437a3258 req-e9a5359e-9f2d-4a8a-912a-c5f74bdf20b5 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:13.913850 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-c694df4c-2934-49b7-bc8b-7b62437a3258 req-e9a5359e-9f2d-4a8a-912a-c5f74bdf20b5 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:13.925236 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-c694df4c-2934-49b7-bc8b-7b62437a3258 req-e9a5359e-9f2d-4a8a-912a-c5f74bdf20b5 service nova] Creating event network-vif-plugged:b0b7c562-0e9c-4a53-b571-448df6f49db9 for instance 81458192-c1e4-464b-916a-dbba42252d64 on hv-cinder-77954 Jun 03 13:11:13.930232 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-c694df4c-2934-49b7-bc8b-7b62437a3258 req-e9a5359e-9f2d-4a8a-912a-c5f74bdf20b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029600 Jun 03 13:11:13.930816 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 301/607] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:11:14.201613 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c0e441ab-926f-4c1c-97c1-6a4c083a1066 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:14.202311 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c0e441ab-926f-4c1c-97c1-6a4c083a1066 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:14.209195 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0e441ab-926f-4c1c-97c1-6a4c083a1066 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:14.209651 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0e441ab-926f-4c1c-97c1-6a4c083a1066 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:14.210465 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0e441ab-926f-4c1c-97c1-6a4c083a1066 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:14.210910 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0e441ab-926f-4c1c-97c1-6a4c083a1066 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:14.349081 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c0e441ab-926f-4c1c-97c1-6a4c083a1066 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:14.357049 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c0e441ab-926f-4c1c-97c1-6a4c083a1066 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1367 microversion: 2.1 time: 0.161020 Jun 03 13:11:14.357595 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 307/608] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:14 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:15.376765 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a9f4c88c-869b-4c4f-8b40-fe28f8849c61 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:15.377403 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a9f4c88c-869b-4c4f-8b40-fe28f8849c61 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:15.384081 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a9f4c88c-869b-4c4f-8b40-fe28f8849c61 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:15.384530 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a9f4c88c-869b-4c4f-8b40-fe28f8849c61 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:15.385298 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a9f4c88c-869b-4c4f-8b40-fe28f8849c61 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:15.385736 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a9f4c88c-869b-4c4f-8b40-fe28f8849c61 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:15.521242 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a9f4c88c-869b-4c4f-8b40-fe28f8849c61 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:15.529810 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a9f4c88c-869b-4c4f-8b40-fe28f8849c61 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1367 microversion: 2.1 time: 0.158546 Jun 03 13:11:15.530434 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 302/609] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:15 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:16.551976 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9f471991-857a-4528-b4c7-b47e634c29e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:16.552559 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9f471991-857a-4528-b4c7-b47e634c29e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:16.555039 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:11:16.560646 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f471991-857a-4528-b4c7-b47e634c29e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:16.561100 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f471991-857a-4528-b4c7-b47e634c29e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:16.561892 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f471991-857a-4528-b4c7-b47e634c29e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:16.562347 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f471991-857a-4528-b4c7-b47e634c29e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:16.702137 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9f471991-857a-4528-b4c7-b47e634c29e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:16.709767 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9f471991-857a-4528-b4c7-b47e634c29e1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1557 microversion: 2.1 time: 0.161734 Jun 03 13:11:16.710388 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 308/610] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:16 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:16.726230 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d01df135-c006-4c95-a274-e39be14a9f82 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:16.726788 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d01df135-c006-4c95-a274-e39be14a9f82 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:16.728692 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:11:16.729385 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:11:16.736219 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d01df135-c006-4c95-a274-e39be14a9f82 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:16.736671 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d01df135-c006-4c95-a274-e39be14a9f82 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:16.737469 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d01df135-c006-4c95-a274-e39be14a9f82 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:16.737879 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d01df135-c006-4c95-a274-e39be14a9f82 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:16.832178 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d01df135-c006-4c95-a274-e39be14a9f82 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109829 Jun 03 13:11:16.832782 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 303/611] 10.222.0.58 () {58 vars in 1274 bytes} [Fri Jun 3 13:11:16 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:11:17.774906 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-d5209b88-a700-40d0-b8da-ab939a239089 req-c35b9a06-debe-42ae-94e3-61d7bc8e0cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81458192-c1e4-464b-916a-dbba42252d64", "tag": "b0b7c562-0e9c-4a53-b571-448df6f49db9"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:11:17.778752 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:11:17.784712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d5209b88-a700-40d0-b8da-ab939a239089 req-c35b9a06-debe-42ae-94e3-61d7bc8e0cd9 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:17.785158 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d5209b88-a700-40d0-b8da-ab939a239089 req-c35b9a06-debe-42ae-94e3-61d7bc8e0cd9 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:17.788189 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:11:17.798802 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-d5209b88-a700-40d0-b8da-ab939a239089 req-c35b9a06-debe-42ae-94e3-61d7bc8e0cd9 service nova] Creating event network-changed:b0b7c562-0e9c-4a53-b571-448df6f49db9 for instance 81458192-c1e4-464b-916a-dbba42252d64 on hv-cinder-77954 Jun 03 13:11:17.803970 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-d5209b88-a700-40d0-b8da-ab939a239089 req-c35b9a06-debe-42ae-94e3-61d7bc8e0cd9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032812 Jun 03 13:11:17.804569 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 309/612] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:11:34.587446 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:11:34.588337 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:11:34.592661 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6c13fadc-ee73-406f-a009-4336671132d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:34.593153 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6c13fadc-ee73-406f-a009-4336671132d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:34.600438 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c13fadc-ee73-406f-a009-4336671132d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:34.600905 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c13fadc-ee73-406f-a009-4336671132d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:34.601641 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c13fadc-ee73-406f-a009-4336671132d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:34.602057 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c13fadc-ee73-406f-a009-4336671132d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:34.626390 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6c13fadc-ee73-406f-a009-4336671132d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/ips" status: 200 len: 151 microversion: 2.20 time: 0.040170 Jun 03 13:11:34.626948 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 304/613] 10.222.0.58 () {60 vars in 1288 bytes} [Fri Jun 3 13:11:34 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:11:36.471551 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cda7e817-fe72-4a86-b56c-eb2b20131295 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:11:36.472134 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cda7e817-fe72-4a86-b56c-eb2b20131295 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:36.479619 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cda7e817-fe72-4a86-b56c-eb2b20131295 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:36.480067 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cda7e817-fe72-4a86-b56c-eb2b20131295 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:36.480829 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cda7e817-fe72-4a86-b56c-eb2b20131295 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:36.481258 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cda7e817-fe72-4a86-b56c-eb2b20131295 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:36.505217 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-cda7e817-fe72-4a86-b56c-eb2b20131295 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lazy-loading 'flavor' on Instance uuid 0321187a-23dc-4d94-a1d1-e341d8fdf035 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:11:36.773690 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cda7e817-fe72-4a86-b56c-eb2b20131295 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "POST /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/action" status: 202 len: 0 microversion: 2.20 time: 0.307768 Jun 03 13:11:36.774353 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 310/614] 10.222.0.58 () {62 vars in 1318 bytes} [Fri Jun 3 13:11:36 2022] POST /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:11:36.783119 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-eeeb0b6f-49e5-4897-a26c-21eff09cd3ff tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:36.783723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-eeeb0b6f-49e5-4897-a26c-21eff09cd3ff tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:36.790530 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eeeb0b6f-49e5-4897-a26c-21eff09cd3ff tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:36.790956 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eeeb0b6f-49e5-4897-a26c-21eff09cd3ff tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:36.791725 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eeeb0b6f-49e5-4897-a26c-21eff09cd3ff tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:36.792154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-eeeb0b6f-49e5-4897-a26c-21eff09cd3ff tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:36.927689 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-eeeb0b6f-49e5-4897-a26c-21eff09cd3ff tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:36.935755 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-eeeb0b6f-49e5-4897-a26c-21eff09cd3ff tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:36.937325 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-eeeb0b6f-49e5-4897-a26c-21eff09cd3ff tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:36.938614 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-eeeb0b6f-49e5-4897-a26c-21eff09cd3ff tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.159620 Jun 03 13:11:36.939181 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 305/615] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:36 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:37.970453 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-76eb3bb1-fcae-47b6-afcb-7d69eb631ffa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:37.971282 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-76eb3bb1-fcae-47b6-afcb-7d69eb631ffa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:37.979257 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76eb3bb1-fcae-47b6-afcb-7d69eb631ffa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:37.979796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76eb3bb1-fcae-47b6-afcb-7d69eb631ffa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:37.980717 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76eb3bb1-fcae-47b6-afcb-7d69eb631ffa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:37.981237 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76eb3bb1-fcae-47b6-afcb-7d69eb631ffa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:38.126632 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-76eb3bb1-fcae-47b6-afcb-7d69eb631ffa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:38.138676 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-76eb3bb1-fcae-47b6-afcb-7d69eb631ffa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:38.140874 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-76eb3bb1-fcae-47b6-afcb-7d69eb631ffa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:38.142052 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-76eb3bb1-fcae-47b6-afcb-7d69eb631ffa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.179016 Jun 03 13:11:38.142650 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 311/616] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:37 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:39.164651 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-50f31208-2383-4e24-acc7-1e9cd3b6a86c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:39.165647 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-50f31208-2383-4e24-acc7-1e9cd3b6a86c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:39.177121 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50f31208-2383-4e24-acc7-1e9cd3b6a86c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:39.177862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50f31208-2383-4e24-acc7-1e9cd3b6a86c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:39.179358 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50f31208-2383-4e24-acc7-1e9cd3b6a86c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:39.180088 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50f31208-2383-4e24-acc7-1e9cd3b6a86c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:39.321833 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-50f31208-2383-4e24-acc7-1e9cd3b6a86c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:39.333679 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-50f31208-2383-4e24-acc7-1e9cd3b6a86c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:39.336219 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-50f31208-2383-4e24-acc7-1e9cd3b6a86c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:39.337920 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-50f31208-2383-4e24-acc7-1e9cd3b6a86c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.179545 Jun 03 13:11:39.338766 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 306/617] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:39 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:40.362931 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a314dc8b-6334-4eb4-a167-ae66c94578fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:40.363601 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a314dc8b-6334-4eb4-a167-ae66c94578fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:40.372203 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a314dc8b-6334-4eb4-a167-ae66c94578fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:40.372740 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a314dc8b-6334-4eb4-a167-ae66c94578fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:40.373651 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a314dc8b-6334-4eb4-a167-ae66c94578fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:40.374176 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a314dc8b-6334-4eb4-a167-ae66c94578fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:40.511129 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a314dc8b-6334-4eb4-a167-ae66c94578fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:40.519546 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a314dc8b-6334-4eb4-a167-ae66c94578fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:40.521058 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-a314dc8b-6334-4eb4-a167-ae66c94578fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:40.522291 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a314dc8b-6334-4eb4-a167-ae66c94578fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.165679 Jun 03 13:11:40.522850 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 312/618] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:40 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:41.541374 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9739a53c-7a9f-49d0-b836-36ad221d35b5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:41.542278 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9739a53c-7a9f-49d0-b836-36ad221d35b5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:41.551523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9739a53c-7a9f-49d0-b836-36ad221d35b5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:41.551967 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9739a53c-7a9f-49d0-b836-36ad221d35b5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:41.552868 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9739a53c-7a9f-49d0-b836-36ad221d35b5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:41.553160 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9739a53c-7a9f-49d0-b836-36ad221d35b5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:41.691326 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9739a53c-7a9f-49d0-b836-36ad221d35b5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:41.703746 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9739a53c-7a9f-49d0-b836-36ad221d35b5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:41.706182 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9739a53c-7a9f-49d0-b836-36ad221d35b5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:41.707563 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9739a53c-7a9f-49d0-b836-36ad221d35b5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.170472 Jun 03 13:11:41.708136 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 307/619] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:41 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:42.735405 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-40ab99bd-5172-4a58-b90d-fc516608d2ba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:42.736461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-40ab99bd-5172-4a58-b90d-fc516608d2ba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:42.748612 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40ab99bd-5172-4a58-b90d-fc516608d2ba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:42.749365 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40ab99bd-5172-4a58-b90d-fc516608d2ba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:42.750699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40ab99bd-5172-4a58-b90d-fc516608d2ba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:42.751425 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40ab99bd-5172-4a58-b90d-fc516608d2ba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:42.897806 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-40ab99bd-5172-4a58-b90d-fc516608d2ba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:42.905910 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-40ab99bd-5172-4a58-b90d-fc516608d2ba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:42.907440 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-40ab99bd-5172-4a58-b90d-fc516608d2ba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:42.908603 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-40ab99bd-5172-4a58-b90d-fc516608d2ba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.179923 Jun 03 13:11:42.909191 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 313/620] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:42 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:43.937268 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ad6a4b59-7f62-4553-a21f-c957d9e397ea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:43.938183 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ad6a4b59-7f62-4553-a21f-c957d9e397ea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:43.949465 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad6a4b59-7f62-4553-a21f-c957d9e397ea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:43.950267 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad6a4b59-7f62-4553-a21f-c957d9e397ea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:43.951545 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad6a4b59-7f62-4553-a21f-c957d9e397ea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:43.952253 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad6a4b59-7f62-4553-a21f-c957d9e397ea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:44.253846 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ad6a4b59-7f62-4553-a21f-c957d9e397ea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:44.262460 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ad6a4b59-7f62-4553-a21f-c957d9e397ea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:44.263962 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ad6a4b59-7f62-4553-a21f-c957d9e397ea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:44.265126 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ad6a4b59-7f62-4553-a21f-c957d9e397ea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.334691 Jun 03 13:11:44.265691 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 308/621] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:43 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:45.287671 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2b3ea983-3be1-4533-8519-095a1c9097f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:45.288691 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2b3ea983-3be1-4533-8519-095a1c9097f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:45.299885 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b3ea983-3be1-4533-8519-095a1c9097f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:45.300682 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b3ea983-3be1-4533-8519-095a1c9097f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:45.301475 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b3ea983-3be1-4533-8519-095a1c9097f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:45.301904 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2b3ea983-3be1-4533-8519-095a1c9097f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:45.444085 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2b3ea983-3be1-4533-8519-095a1c9097f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:45.452281 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2b3ea983-3be1-4533-8519-095a1c9097f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:45.453785 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2b3ea983-3be1-4533-8519-095a1c9097f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:45.454970 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2b3ea983-3be1-4533-8519-095a1c9097f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.173988 Jun 03 13:11:45.455533 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 314/622] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:45 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:46.477862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-47056593-71e6-454b-82d3-ba6a48f96de2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:46.478877 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-47056593-71e6-454b-82d3-ba6a48f96de2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:46.490740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47056593-71e6-454b-82d3-ba6a48f96de2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:46.491490 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47056593-71e6-454b-82d3-ba6a48f96de2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:46.492769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47056593-71e6-454b-82d3-ba6a48f96de2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:46.493493 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47056593-71e6-454b-82d3-ba6a48f96de2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:46.650758 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-47056593-71e6-454b-82d3-ba6a48f96de2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:46.658883 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-47056593-71e6-454b-82d3-ba6a48f96de2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:46.660390 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-47056593-71e6-454b-82d3-ba6a48f96de2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:46.661542 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-47056593-71e6-454b-82d3-ba6a48f96de2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.190456 Jun 03 13:11:46.662144 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 309/623] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:46 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:47.684119 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b8b86c1b-6d82-4999-a612-65a656c87aa4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:47.685130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b8b86c1b-6d82-4999-a612-65a656c87aa4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:47.696480 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b8b86c1b-6d82-4999-a612-65a656c87aa4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:47.697199 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b8b86c1b-6d82-4999-a612-65a656c87aa4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:47.698547 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b8b86c1b-6d82-4999-a612-65a656c87aa4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:47.699272 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b8b86c1b-6d82-4999-a612-65a656c87aa4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:47.839094 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b8b86c1b-6d82-4999-a612-65a656c87aa4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:47.850094 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b8b86c1b-6d82-4999-a612-65a656c87aa4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:47.851767 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b8b86c1b-6d82-4999-a612-65a656c87aa4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:47.852938 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b8b86c1b-6d82-4999-a612-65a656c87aa4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.175326 Jun 03 13:11:47.853475 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 315/624] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:47 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:48.875885 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c637aef0-de25-41ec-ad22-d1d60062ed42 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:48.876887 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c637aef0-de25-41ec-ad22-d1d60062ed42 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:48.887473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c637aef0-de25-41ec-ad22-d1d60062ed42 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:48.888228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c637aef0-de25-41ec-ad22-d1d60062ed42 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:48.889511 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c637aef0-de25-41ec-ad22-d1d60062ed42 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:48.890278 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c637aef0-de25-41ec-ad22-d1d60062ed42 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:49.031461 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c637aef0-de25-41ec-ad22-d1d60062ed42 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:49.045392 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c637aef0-de25-41ec-ad22-d1d60062ed42 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:49.047785 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c637aef0-de25-41ec-ad22-d1d60062ed42 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:49.049612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c637aef0-de25-41ec-ad22-d1d60062ed42 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.180484 Jun 03 13:11:49.050660 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 310/625] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:48 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:50.072768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8aa9e626-018d-4339-a564-10bba1029943 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:50.073748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8aa9e626-018d-4339-a564-10bba1029943 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:50.084394 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8aa9e626-018d-4339-a564-10bba1029943 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:50.085144 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8aa9e626-018d-4339-a564-10bba1029943 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:50.086487 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8aa9e626-018d-4339-a564-10bba1029943 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:50.087219 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8aa9e626-018d-4339-a564-10bba1029943 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:50.247238 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8aa9e626-018d-4339-a564-10bba1029943 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:50.255625 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8aa9e626-018d-4339-a564-10bba1029943 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:50.257134 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8aa9e626-018d-4339-a564-10bba1029943 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:50.258322 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8aa9e626-018d-4339-a564-10bba1029943 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.192675 Jun 03 13:11:50.258902 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 316/626] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:50 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:51.280877 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e4f67dca-7779-4392-bed8-c03ccc4161e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:51.281736 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e4f67dca-7779-4392-bed8-c03ccc4161e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:51.293233 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4f67dca-7779-4392-bed8-c03ccc4161e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:51.293988 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4f67dca-7779-4392-bed8-c03ccc4161e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:51.295290 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4f67dca-7779-4392-bed8-c03ccc4161e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:51.296054 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4f67dca-7779-4392-bed8-c03ccc4161e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:51.433555 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e4f67dca-7779-4392-bed8-c03ccc4161e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:51.446277 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e4f67dca-7779-4392-bed8-c03ccc4161e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:51.448427 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e4f67dca-7779-4392-bed8-c03ccc4161e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:51.450381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e4f67dca-7779-4392-bed8-c03ccc4161e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.175931 Jun 03 13:11:51.451191 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 311/627] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:51 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:52.471521 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f94b216-22ba-4cc2-abd1-30680871e654 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:52.472288 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f94b216-22ba-4cc2-abd1-30680871e654 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:52.479383 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f94b216-22ba-4cc2-abd1-30680871e654 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:52.479829 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f94b216-22ba-4cc2-abd1-30680871e654 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:52.480594 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f94b216-22ba-4cc2-abd1-30680871e654 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:52.481024 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f94b216-22ba-4cc2-abd1-30680871e654 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:52.619596 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f94b216-22ba-4cc2-abd1-30680871e654 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:52.631613 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f94b216-22ba-4cc2-abd1-30680871e654 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:52.633908 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f94b216-22ba-4cc2-abd1-30680871e654 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:52.635701 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f94b216-22ba-4cc2-abd1-30680871e654 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.167884 Jun 03 13:11:52.636418 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 317/628] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:52 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:53.660464 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9a7c6925-5f7c-4852-8efe-7d2eb8fc04bb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:53.661971 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9a7c6925-5f7c-4852-8efe-7d2eb8fc04bb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:53.671818 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a7c6925-5f7c-4852-8efe-7d2eb8fc04bb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:53.672500 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a7c6925-5f7c-4852-8efe-7d2eb8fc04bb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:53.673669 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a7c6925-5f7c-4852-8efe-7d2eb8fc04bb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:53.674376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a7c6925-5f7c-4852-8efe-7d2eb8fc04bb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:53.825062 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9a7c6925-5f7c-4852-8efe-7d2eb8fc04bb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:53.837546 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9a7c6925-5f7c-4852-8efe-7d2eb8fc04bb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:53.839786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9a7c6925-5f7c-4852-8efe-7d2eb8fc04bb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:53.841412 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9a7c6925-5f7c-4852-8efe-7d2eb8fc04bb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1744 microversion: 2.20 time: 0.186994 Jun 03 13:11:53.842320 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 312/629] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:53 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:54.864447 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3b285cc0-482c-4ba2-8232-d2397f4642f9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:54.865050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3b285cc0-482c-4ba2-8232-d2397f4642f9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:54.872606 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b285cc0-482c-4ba2-8232-d2397f4642f9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:54.873084 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b285cc0-482c-4ba2-8232-d2397f4642f9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:54.873896 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b285cc0-482c-4ba2-8232-d2397f4642f9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:54.874396 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3b285cc0-482c-4ba2-8232-d2397f4642f9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:55.012625 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3b285cc0-482c-4ba2-8232-d2397f4642f9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:55.020829 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3b285cc0-482c-4ba2-8232-d2397f4642f9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:55.022442 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3b285cc0-482c-4ba2-8232-d2397f4642f9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:55.023594 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3b285cc0-482c-4ba2-8232-d2397f4642f9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1744 microversion: 2.20 time: 0.166133 Jun 03 13:11:55.024153 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 318/630] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:54 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:56.041607 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d6cb8d09-35d2-43a6-8653-ebffa7183025 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:56.042315 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d6cb8d09-35d2-43a6-8653-ebffa7183025 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:56.050036 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6cb8d09-35d2-43a6-8653-ebffa7183025 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:56.050522 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6cb8d09-35d2-43a6-8653-ebffa7183025 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:56.051489 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6cb8d09-35d2-43a6-8653-ebffa7183025 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:56.051984 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d6cb8d09-35d2-43a6-8653-ebffa7183025 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:56.157024 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-d03b67bc-3cb7-4aba-ad85-a7957a756588 req-f192b870-774a-4bea-99ad-7b3775f79615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0321187a-23dc-4d94-a1d1-e341d8fdf035", "name": "network-vif-plugged", "status": "completed", "tag": "1fae557f-ecd4-4f44-ad00-3f1f17914ef1"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:11:56.166305 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d03b67bc-3cb7-4aba-ad85-a7957a756588 req-f192b870-774a-4bea-99ad-7b3775f79615 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:56.166789 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-d03b67bc-3cb7-4aba-ad85-a7957a756588 req-f192b870-774a-4bea-99ad-7b3775f79615 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:56.179447 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-d03b67bc-3cb7-4aba-ad85-a7957a756588 req-f192b870-774a-4bea-99ad-7b3775f79615 service nova] Creating event network-vif-plugged:1fae557f-ecd4-4f44-ad00-3f1f17914ef1 for instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 on hv-cinder-77954 Jun 03 13:11:56.184610 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-d03b67bc-3cb7-4aba-ad85-a7957a756588 req-f192b870-774a-4bea-99ad-7b3775f79615 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032033 Jun 03 13:11:56.185644 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 319/631] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:11:56.193592 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d6cb8d09-35d2-43a6-8653-ebffa7183025 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:56.201842 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d6cb8d09-35d2-43a6-8653-ebffa7183025 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:56.203373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d6cb8d09-35d2-43a6-8653-ebffa7183025 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:56.204534 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d6cb8d09-35d2-43a6-8653-ebffa7183025 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1744 microversion: 2.20 time: 0.167214 Jun 03 13:11:56.205503 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 313/632] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:56 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:57.228751 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5ab44667-5ef7-4b15-8172-3411b04cb9a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:57.229873 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5ab44667-5ef7-4b15-8172-3411b04cb9a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:57.240757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ab44667-5ef7-4b15-8172-3411b04cb9a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:57.241212 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ab44667-5ef7-4b15-8172-3411b04cb9a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:57.241977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ab44667-5ef7-4b15-8172-3411b04cb9a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:57.242472 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5ab44667-5ef7-4b15-8172-3411b04cb9a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:57.402396 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5ab44667-5ef7-4b15-8172-3411b04cb9a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:57.415722 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5ab44667-5ef7-4b15-8172-3411b04cb9a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:57.418051 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5ab44667-5ef7-4b15-8172-3411b04cb9a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:57.419833 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5ab44667-5ef7-4b15-8172-3411b04cb9a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1744 microversion: 2.20 time: 0.198293 Jun 03 13:11:57.420676 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 320/633] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:57 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1744 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:57.521640 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5e45408a-bc9b-4ed0-b172-9c8d7f6f0466 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:57.522532 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5e45408a-bc9b-4ed0-b172-9c8d7f6f0466 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:57.533659 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5e45408a-bc9b-4ed0-b172-9c8d7f6f0466 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:57.534482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5e45408a-bc9b-4ed0-b172-9c8d7f6f0466 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:57.535696 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5e45408a-bc9b-4ed0-b172-9c8d7f6f0466 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:57.536140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5e45408a-bc9b-4ed0-b172-9c8d7f6f0466 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:57.561338 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5e45408a-bc9b-4ed0-b172-9c8d7f6f0466 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:11:57.641333 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5e45408a-bc9b-4ed0-b172-9c8d7f6f0466 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 204 len: 0 microversion: 2.1 time: 0.126216 Jun 03 13:11:57.642025 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 314/634] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:11:57 2022] DELETE /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:11:57.650746 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c6f16653-cdeb-4ecb-9b1a-b9e8973eb918 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:57.651362 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c6f16653-cdeb-4ecb-9b1a-b9e8973eb918 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:57.660130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6f16653-cdeb-4ecb-9b1a-b9e8973eb918 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:57.660655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6f16653-cdeb-4ecb-9b1a-b9e8973eb918 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:57.661447 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6f16653-cdeb-4ecb-9b1a-b9e8973eb918 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:57.661883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c6f16653-cdeb-4ecb-9b1a-b9e8973eb918 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:57.806577 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c6f16653-cdeb-4ecb-9b1a-b9e8973eb918 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:57.814446 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c6f16653-cdeb-4ecb-9b1a-b9e8973eb918 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1578 microversion: 2.1 time: 0.167618 Jun 03 13:11:57.815021 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 321/635] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:57 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:58.442965 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2f59fede-3349-4f75-b6ba-e45331309ae5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:58.443650 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2f59fede-3349-4f75-b6ba-e45331309ae5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:58.450635 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f59fede-3349-4f75-b6ba-e45331309ae5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:58.451082 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f59fede-3349-4f75-b6ba-e45331309ae5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:58.451824 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f59fede-3349-4f75-b6ba-e45331309ae5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:58.452273 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2f59fede-3349-4f75-b6ba-e45331309ae5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:58.595220 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2f59fede-3349-4f75-b6ba-e45331309ae5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:58.608471 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2f59fede-3349-4f75-b6ba-e45331309ae5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:58.610911 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2f59fede-3349-4f75-b6ba-e45331309ae5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:58.612733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2f59fede-3349-4f75-b6ba-e45331309ae5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1744 microversion: 2.20 time: 0.176242 Jun 03 13:11:58.613530 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 315/636] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:58 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:11:58.835998 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-eff6a1e4-66f2-4cf4-9521-7dbb90576a71 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:58.836753 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-eff6a1e4-66f2-4cf4-9521-7dbb90576a71 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:58.845779 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eff6a1e4-66f2-4cf4-9521-7dbb90576a71 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:58.846448 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eff6a1e4-66f2-4cf4-9521-7dbb90576a71 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:58.847481 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eff6a1e4-66f2-4cf4-9521-7dbb90576a71 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:58.848261 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eff6a1e4-66f2-4cf4-9521-7dbb90576a71 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:58.984548 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-eff6a1e4-66f2-4cf4-9521-7dbb90576a71 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:58.993231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-eff6a1e4-66f2-4cf4-9521-7dbb90576a71 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1578 microversion: 2.1 time: 0.163392 Jun 03 13:11:58.993824 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 322/637] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:11:58 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:11:59.631495 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a928905f-a318-4078-b835-7e9a0b3febe8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:11:59.632966 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a928905f-a318-4078-b835-7e9a0b3febe8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:11:59.646227 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a928905f-a318-4078-b835-7e9a0b3febe8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:59.646963 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a928905f-a318-4078-b835-7e9a0b3febe8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:59.648015 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a928905f-a318-4078-b835-7e9a0b3febe8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:11:59.648611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a928905f-a318-4078-b835-7e9a0b3febe8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:11:59.815314 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a928905f-a318-4078-b835-7e9a0b3febe8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:59.824003 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a928905f-a318-4078-b835-7e9a0b3febe8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:59.825512 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a928905f-a318-4078-b835-7e9a0b3febe8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:11:59.826736 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a928905f-a318-4078-b835-7e9a0b3febe8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1739 microversion: 2.20 time: 0.199625 Jun 03 13:11:59.827293 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 316/638] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:11:59 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:00.012035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-65dafe24-35c3-4b6e-8fc0-e5c98b690029 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:00.012922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-65dafe24-35c3-4b6e-8fc0-e5c98b690029 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:00.022814 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-65dafe24-35c3-4b6e-8fc0-e5c98b690029 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:00.025081 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-65dafe24-35c3-4b6e-8fc0-e5c98b690029 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:00.027077 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-65dafe24-35c3-4b6e-8fc0-e5c98b690029 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:00.027755 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-65dafe24-35c3-4b6e-8fc0-e5c98b690029 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:00.174862 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-65dafe24-35c3-4b6e-8fc0-e5c98b690029 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:00.193102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-65dafe24-35c3-4b6e-8fc0-e5c98b690029 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1578 microversion: 2.1 time: 0.185454 Jun 03 13:12:00.194098 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 323/639] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:00 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:00.658751 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-eee8e13f-f1ac-477e-8b73-95a647bfe80f req-f23b71f0-6078-40f7-bc41-17e05c3b7ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba60da9-2b35-486d-94f0-3d134c9fdf3b", "name": "network-vif-deleted", "tag": "2a060abd-a85c-4086-ba6b-e30215497801"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:12:00.673009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-eee8e13f-f1ac-477e-8b73-95a647bfe80f req-f23b71f0-6078-40f7-bc41-17e05c3b7ab1 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:00.673452 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-eee8e13f-f1ac-477e-8b73-95a647bfe80f req-f23b71f0-6078-40f7-bc41-17e05c3b7ab1 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:00.693228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-eee8e13f-f1ac-477e-8b73-95a647bfe80f req-f23b71f0-6078-40f7-bc41-17e05c3b7ab1 service nova] Creating event network-vif-deleted:2a060abd-a85c-4086-ba6b-e30215497801 for instance cba60da9-2b35-486d-94f0-3d134c9fdf3b on hv-cinder-77954 Jun 03 13:12:00.704166 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-eee8e13f-f1ac-477e-8b73-95a647bfe80f req-f23b71f0-6078-40f7-bc41-17e05c3b7ab1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048238 Jun 03 13:12:00.705595 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 317/640] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:12:00.845011 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9a4dc3fa-788b-40b6-aa67-0512aabf1e1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:00.845935 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9a4dc3fa-788b-40b6-aa67-0512aabf1e1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:00.864914 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a4dc3fa-788b-40b6-aa67-0512aabf1e1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:00.866332 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a4dc3fa-788b-40b6-aa67-0512aabf1e1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:00.867518 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a4dc3fa-788b-40b6-aa67-0512aabf1e1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:00.868131 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9a4dc3fa-788b-40b6-aa67-0512aabf1e1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:01.056555 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9a4dc3fa-788b-40b6-aa67-0512aabf1e1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:01.065877 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9a4dc3fa-788b-40b6-aa67-0512aabf1e1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:01.071386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9a4dc3fa-788b-40b6-aa67-0512aabf1e1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:01.074150 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9a4dc3fa-788b-40b6-aa67-0512aabf1e1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1739 microversion: 2.20 time: 0.232251 Jun 03 13:12:01.075278 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 324/641] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:00 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:01.211452 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6de5ee63-2053-4418-839b-cfb9a052c51f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:01.212261 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6de5ee63-2053-4418-839b-cfb9a052c51f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:01.218858 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6de5ee63-2053-4418-839b-cfb9a052c51f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:01.219613 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6de5ee63-2053-4418-839b-cfb9a052c51f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:01.220580 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6de5ee63-2053-4418-839b-cfb9a052c51f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:01.221202 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6de5ee63-2053-4418-839b-cfb9a052c51f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:01.255956 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6de5ee63-2053-4418-839b-cfb9a052c51f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:01.256709 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6de5ee63-2053-4418-839b-cfb9a052c51f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:01.257345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-6de5ee63-2053-4418-839b-cfb9a052c51f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lazy-loading 'fault' on Instance uuid cba60da9-2b35-486d-94f0-3d134c9fdf3b {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:12:01.303328 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6de5ee63-2053-4418-839b-cfb9a052c51f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:01.312107 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6de5ee63-2053-4418-839b-cfb9a052c51f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 200 len: 1231 microversion: 2.1 time: 0.105315 Jun 03 13:12:01.313715 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 318/642] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:01 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:02.093614 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-896399a8-ba03-4ec8-9032-72cd315e1be7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:02.094244 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-896399a8-ba03-4ec8-9032-72cd315e1be7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:02.100972 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-896399a8-ba03-4ec8-9032-72cd315e1be7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:02.101432 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-896399a8-ba03-4ec8-9032-72cd315e1be7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:02.102255 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-896399a8-ba03-4ec8-9032-72cd315e1be7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:02.102695 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-896399a8-ba03-4ec8-9032-72cd315e1be7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:02.105404 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:02.238102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-896399a8-ba03-4ec8-9032-72cd315e1be7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:02.247262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-896399a8-ba03-4ec8-9032-72cd315e1be7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:02.249028 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-896399a8-ba03-4ec8-9032-72cd315e1be7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:02.250427 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-896399a8-ba03-4ec8-9032-72cd315e1be7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1739 microversion: 2.20 time: 0.161406 Jun 03 13:12:02.251208 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 325/643] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:02 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:02.333080 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-db261c87-3bac-4e7f-92de-1aa34d339b0d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:02.333769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-db261c87-3bac-4e7f-92de-1aa34d339b0d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:02.342943 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db261c87-3bac-4e7f-92de-1aa34d339b0d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:02.343494 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db261c87-3bac-4e7f-92de-1aa34d339b0d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:02.344712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db261c87-3bac-4e7f-92de-1aa34d339b0d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:02.345644 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db261c87-3bac-4e7f-92de-1aa34d339b0d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:02.366009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-db261c87-3bac-4e7f-92de-1aa34d339b0d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] HTTP exception thrown: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-db261c87-3bac-4e7f-92de-1aa34d339b0d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Request method failure captured: Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b HTTP/1.1 Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgfeytFCBbTmb-nz0uvAugFHpDwiFmPgvH_bG5Vy_Ec3SvGI2rOcvMxSoI2S-HBNeAyqE38UVPxXlG8sHf0HI9aWoGAzNP5fTq-U_PNGiatpW79wFlOFg2LOlPMWCvQqv1olELFZPDbJ2A_WiDzfMFgAPlCNn3_wxICqPgugH7zGX58 Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 2fd9de1783e54cafadd25ecc97876288 Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-TestVolumeBootPattern-537336768 Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:12:02.368035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:12:02.369421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd9de1783e54cafadd25ecc97876288"}]}] Jun 03 13:12:02.369421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-TestVolumeBootPattern-537336768 Jun 03 13:12:02.369421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 2fd9de1783e54cafadd25ecc97876288 Jun 03 13:12:02.369421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-TestVolumeBootPattern-537336768 Jun 03 13:12:02.369421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-TestVolumeBootPattern-537336768-project Jun 03 13:12:02.369421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:12:02.369421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:12:02.369421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 62f5e92899b84d5594a34643b662d233 Jun 03 13:12:02.369421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-TestVolumeBootPattern-537336768-project Jun 03 13:12:02.369421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:12:02.369421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:12:02.369421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': 'cba60da9-2b35-486d-94f0-3d134c9fdf3b'} Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:12:02.370263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:12:02.371537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:02.372675 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-db261c87-3bac-4e7f-92de-1aa34d339b0d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Returning 404 to user: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:12:02.372675 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-db261c87-3bac-4e7f-92de-1aa34d339b0d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 404 len: 111 microversion: 2.1 time: 0.041874 Jun 03 13:12:02.372675 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 319/644] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:02 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:12:02.474756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-914201219", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2140023348", "security_groups": [{"name": "tempest-secgroup-smoke-720825641"}], "block_device_mapping_v2": [{"uuid": "850afe75-d0ca-4fe0-ae6d-b12322140504", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d4fbee0d-2302-4e0a-ad7f-1d9dc25e1db8"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:12:02.615064 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] validate_networks() for [('d4fbee0d-2302-4e0a-ad7f-1d9dc25e1db8', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:12:03.033870 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:12:03.034365 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:12:03.034848 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:12:03.035343 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:12:03.036052 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:12:03.045141 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:03.045588 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:03.046416 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:03.046852 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:03.064123 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Getting quotas for project 2fd9de1783e54cafadd25ecc97876288. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:12:03.068468 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Getting quotas for user 62f5e92899b84d5594a34643b662d233 and project 2fd9de1783e54cafadd25ecc97876288. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:12:03.129735 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:12:03.131894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='850afe75-d0ca-4fe0-ae6d-b12322140504',volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:12:03.271602 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d55146ec-e231-482e-8db9-efc94e56dfae tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:03.272638 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d55146ec-e231-482e-8db9-efc94e56dfae tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:03.279626 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d55146ec-e231-482e-8db9-efc94e56dfae tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:03.280182 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d55146ec-e231-482e-8db9-efc94e56dfae tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:03.281037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d55146ec-e231-482e-8db9-efc94e56dfae tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:03.282412 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d55146ec-e231-482e-8db9-efc94e56dfae tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:03.284076 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d5ee8c4d-8e54-48ca-9a51-28133c66a9be tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.815051 Jun 03 13:12:03.285612 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 326/645] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:12:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 13:12:03.288965 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:03.295838 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e8890e05-f740-43db-8e64-0684895c41d1 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:03.296741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e8890e05-f740-43db-8e64-0684895c41d1 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:03.407343 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e8890e05-f740-43db-8e64-0684895c41d1 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:03.418468 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e8890e05-f740-43db-8e64-0684895c41d1 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1094 microversion: 2.1 time: 0.126968 Jun 03 13:12:03.419281 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 327/646] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:03 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1094 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:03.527654 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d55146ec-e231-482e-8db9-efc94e56dfae tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:03.539123 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d55146ec-e231-482e-8db9-efc94e56dfae tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:03.541081 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d55146ec-e231-482e-8db9-efc94e56dfae tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:03.542701 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d55146ec-e231-482e-8db9-efc94e56dfae tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1739 microversion: 2.20 time: 0.275905 Jun 03 13:12:03.543809 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 320/647] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:03 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:12:04.435586 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-df75da2f-3a08-4581-9dbe-c2bf51ca2803 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:04.436181 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-df75da2f-3a08-4581-9dbe-c2bf51ca2803 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:04.443637 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df75da2f-3a08-4581-9dbe-c2bf51ca2803 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:04.444486 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df75da2f-3a08-4581-9dbe-c2bf51ca2803 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:04.447031 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df75da2f-3a08-4581-9dbe-c2bf51ca2803 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:04.447707 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-df75da2f-3a08-4581-9dbe-c2bf51ca2803 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:04.527766 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-df75da2f-3a08-4581-9dbe-c2bf51ca2803 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:04.539401 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-df75da2f-3a08-4581-9dbe-c2bf51ca2803 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1200 microversion: 2.1 time: 0.107715 Jun 03 13:12:04.540684 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 328/648] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:04 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1200 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:04.565575 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-307bbf7c-1f48-4039-b14b-ea13afe6b20a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:04.567634 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-307bbf7c-1f48-4039-b14b-ea13afe6b20a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:04.578139 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-307bbf7c-1f48-4039-b14b-ea13afe6b20a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:04.578139 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-307bbf7c-1f48-4039-b14b-ea13afe6b20a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:04.578139 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-307bbf7c-1f48-4039-b14b-ea13afe6b20a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:04.578139 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-307bbf7c-1f48-4039-b14b-ea13afe6b20a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:04.794032 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-307bbf7c-1f48-4039-b14b-ea13afe6b20a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:04.808687 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-307bbf7c-1f48-4039-b14b-ea13afe6b20a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:04.813831 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-307bbf7c-1f48-4039-b14b-ea13afe6b20a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:04.819847 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-307bbf7c-1f48-4039-b14b-ea13afe6b20a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1739 microversion: 2.20 time: 0.262899 Jun 03 13:12:04.820544 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 321/649] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:04 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:05.561685 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7e75457c-bcbc-470b-b6b8-f637a63447d8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:05.562526 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7e75457c-bcbc-470b-b6b8-f637a63447d8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:05.585371 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e75457c-bcbc-470b-b6b8-f637a63447d8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:05.588065 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e75457c-bcbc-470b-b6b8-f637a63447d8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:05.591126 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e75457c-bcbc-470b-b6b8-f637a63447d8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:05.592281 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e75457c-bcbc-470b-b6b8-f637a63447d8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:05.840187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-08759a84-f264-4374-90ae-1e46f4781356 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:05.840762 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-08759a84-f264-4374-90ae-1e46f4781356 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:05.856102 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:05.857952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-08759a84-f264-4374-90ae-1e46f4781356 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:05.859210 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-08759a84-f264-4374-90ae-1e46f4781356 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:05.868975 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-08759a84-f264-4374-90ae-1e46f4781356 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:05.875112 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-08759a84-f264-4374-90ae-1e46f4781356 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:06.286507 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7e75457c-bcbc-470b-b6b8-f637a63447d8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:06.296840 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7e75457c-bcbc-470b-b6b8-f637a63447d8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1265 microversion: 2.1 time: 0.741970 Jun 03 13:12:06.302251 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 329/650] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:05 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1265 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:06.316168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-08759a84-f264-4374-90ae-1e46f4781356 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:06.333764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-08759a84-f264-4374-90ae-1e46f4781356 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:06.338769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-08759a84-f264-4374-90ae-1e46f4781356 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:06.342656 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-08759a84-f264-4374-90ae-1e46f4781356 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1739 microversion: 2.20 time: 0.508135 Jun 03 13:12:06.358873 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 322/651] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:05 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1739 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:06.484790 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-cecc15ad-649b-4a66-8fd9-a5c2dc84056d req-e4cd1770-a198-4bf0-9be9-31de5ba93011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4366f6f4-c8c3-4f29-af5e-94a09d9043d2", "tag": "4d7fd1c2-1a76-429a-9e14-45cde7f9a713"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:12:06.488752 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:06.501480 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-cecc15ad-649b-4a66-8fd9-a5c2dc84056d req-e4cd1770-a198-4bf0-9be9-31de5ba93011 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:06.509558 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-cecc15ad-649b-4a66-8fd9-a5c2dc84056d req-e4cd1770-a198-4bf0-9be9-31de5ba93011 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:06.524364 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-cecc15ad-649b-4a66-8fd9-a5c2dc84056d req-e4cd1770-a198-4bf0-9be9-31de5ba93011 service nova] Creating event network-changed:4d7fd1c2-1a76-429a-9e14-45cde7f9a713 for instance 4366f6f4-c8c3-4f29-af5e-94a09d9043d2 on hv-cinder-77954 Jun 03 13:12:06.531208 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-cecc15ad-649b-4a66-8fd9-a5c2dc84056d req-e4cd1770-a198-4bf0-9be9-31de5ba93011 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049520 Jun 03 13:12:06.532468 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 330/652] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:12:07.319795 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6b57ddff-d1cc-480f-bb19-475479a0e910 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:07.321164 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6b57ddff-d1cc-480f-bb19-475479a0e910 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:07.328339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b57ddff-d1cc-480f-bb19-475479a0e910 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:07.329268 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b57ddff-d1cc-480f-bb19-475479a0e910 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:07.330245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b57ddff-d1cc-480f-bb19-475479a0e910 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:07.330679 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6b57ddff-d1cc-480f-bb19-475479a0e910 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:07.366996 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-94223a55-aab3-449c-ba1b-e5a106367026 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:07.368418 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-94223a55-aab3-449c-ba1b-e5a106367026 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:07.379891 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94223a55-aab3-449c-ba1b-e5a106367026 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:07.380675 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94223a55-aab3-449c-ba1b-e5a106367026 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:07.381537 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94223a55-aab3-449c-ba1b-e5a106367026 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:07.382257 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-94223a55-aab3-449c-ba1b-e5a106367026 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:07.515901 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6b57ddff-d1cc-480f-bb19-475479a0e910 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:07.525823 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6b57ddff-d1cc-480f-bb19-475479a0e910 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1265 microversion: 2.1 time: 0.210671 Jun 03 13:12:07.527134 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 323/653] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:07 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:07.586884 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94223a55-aab3-449c-ba1b-e5a106367026 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:07.596309 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94223a55-aab3-449c-ba1b-e5a106367026 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:07.598172 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-94223a55-aab3-449c-ba1b-e5a106367026 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:07.599870 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-94223a55-aab3-449c-ba1b-e5a106367026 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1739 microversion: 2.20 time: 0.238168 Jun 03 13:12:07.611219 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 331/654] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:07 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:12:08.550751 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-75201d3c-e8fe-4cff-b1aa-475feccf7378 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:08.551514 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-75201d3c-e8fe-4cff-b1aa-475feccf7378 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:08.559139 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75201d3c-e8fe-4cff-b1aa-475feccf7378 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:08.559882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75201d3c-e8fe-4cff-b1aa-475feccf7378 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:08.560959 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75201d3c-e8fe-4cff-b1aa-475feccf7378 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:08.561493 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-75201d3c-e8fe-4cff-b1aa-475feccf7378 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:08.618869 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-36bcfd68-f61d-456a-adf9-f74e6d7a0269 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:08.619468 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-36bcfd68-f61d-456a-adf9-f74e6d7a0269 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:08.627842 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-36bcfd68-f61d-456a-adf9-f74e6d7a0269 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:08.630220 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-36bcfd68-f61d-456a-adf9-f74e6d7a0269 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:08.631192 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-36bcfd68-f61d-456a-adf9-f74e6d7a0269 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:08.631718 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-36bcfd68-f61d-456a-adf9-f74e6d7a0269 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:08.776348 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-75201d3c-e8fe-4cff-b1aa-475feccf7378 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:08.785307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-75201d3c-e8fe-4cff-b1aa-475feccf7378 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1265 microversion: 2.1 time: 0.245157 Jun 03 13:12:08.792887 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 324/655] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:08 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:08.813907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-36bcfd68-f61d-456a-adf9-f74e6d7a0269 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:08.823375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-36bcfd68-f61d-456a-adf9-f74e6d7a0269 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:08.824898 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-36bcfd68-f61d-456a-adf9-f74e6d7a0269 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:08.826045 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-36bcfd68-f61d-456a-adf9-f74e6d7a0269 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1739 microversion: 2.20 time: 0.211078 Jun 03 13:12:08.834297 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 332/656] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:08 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:12:09.802534 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f43ce1de-7f21-4b5e-bfc3-0d8ceb9c8176 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:09.803226 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f43ce1de-7f21-4b5e-bfc3-0d8ceb9c8176 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:09.810279 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f43ce1de-7f21-4b5e-bfc3-0d8ceb9c8176 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:09.810662 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f43ce1de-7f21-4b5e-bfc3-0d8ceb9c8176 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:09.811426 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f43ce1de-7f21-4b5e-bfc3-0d8ceb9c8176 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:09.811863 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f43ce1de-7f21-4b5e-bfc3-0d8ceb9c8176 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:09.853440 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f03dc0b4-37a0-4ef2-8f2a-0ee3406df8d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:09.854103 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f03dc0b4-37a0-4ef2-8f2a-0ee3406df8d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:09.868557 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f03dc0b4-37a0-4ef2-8f2a-0ee3406df8d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:09.869009 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f03dc0b4-37a0-4ef2-8f2a-0ee3406df8d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:09.869918 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f03dc0b4-37a0-4ef2-8f2a-0ee3406df8d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:09.870441 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f03dc0b4-37a0-4ef2-8f2a-0ee3406df8d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:10.026933 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f43ce1de-7f21-4b5e-bfc3-0d8ceb9c8176 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:10.034533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f43ce1de-7f21-4b5e-bfc3-0d8ceb9c8176 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1265 microversion: 2.1 time: 0.236129 Jun 03 13:12:10.035349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 325/657] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:09 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:10.056350 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f03dc0b4-37a0-4ef2-8f2a-0ee3406df8d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:10.064349 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f03dc0b4-37a0-4ef2-8f2a-0ee3406df8d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:10.065794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f03dc0b4-37a0-4ef2-8f2a-0ee3406df8d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:10.066982 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f03dc0b4-37a0-4ef2-8f2a-0ee3406df8d5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1739 microversion: 2.20 time: 0.221175 Jun 03 13:12:10.067580 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 333/658] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:09 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:11.050755 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3b5cb9f7-08d1-4f9b-b19d-41c7b33dde49 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:11.051347 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3b5cb9f7-08d1-4f9b-b19d-41c7b33dde49 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:11.058038 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b5cb9f7-08d1-4f9b-b19d-41c7b33dde49 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:11.058516 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b5cb9f7-08d1-4f9b-b19d-41c7b33dde49 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:11.059288 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b5cb9f7-08d1-4f9b-b19d-41c7b33dde49 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:11.059726 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3b5cb9f7-08d1-4f9b-b19d-41c7b33dde49 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:11.085356 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7bbec7d8-98d7-4565-8019-97522e391398 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:11.085973 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7bbec7d8-98d7-4565-8019-97522e391398 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:11.092839 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bbec7d8-98d7-4565-8019-97522e391398 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:11.093573 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bbec7d8-98d7-4565-8019-97522e391398 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:11.094709 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bbec7d8-98d7-4565-8019-97522e391398 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:11.095222 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bbec7d8-98d7-4565-8019-97522e391398 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:11.251806 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3b5cb9f7-08d1-4f9b-b19d-41c7b33dde49 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:11.260333 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3b5cb9f7-08d1-4f9b-b19d-41c7b33dde49 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1265 microversion: 2.1 time: 0.213525 Jun 03 13:12:11.260887 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 326/659] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:11 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:11.276312 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7bbec7d8-98d7-4565-8019-97522e391398 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:11.284937 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7bbec7d8-98d7-4565-8019-97522e391398 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:11.286562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7bbec7d8-98d7-4565-8019-97522e391398 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:11.287959 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7bbec7d8-98d7-4565-8019-97522e391398 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1721 microversion: 2.20 time: 0.206747 Jun 03 13:12:11.288527 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 334/660] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:11 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:12.282665 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-caab9fb4-9afc-460e-ad39-a4c8656029f3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:12.283719 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-caab9fb4-9afc-460e-ad39-a4c8656029f3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:12.294753 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-caab9fb4-9afc-460e-ad39-a4c8656029f3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:12.295514 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-caab9fb4-9afc-460e-ad39-a4c8656029f3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:12.296788 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-caab9fb4-9afc-460e-ad39-a4c8656029f3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:12.297516 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-caab9fb4-9afc-460e-ad39-a4c8656029f3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:12.306875 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f0857e2e-e67a-42f8-b4aa-24740b18fc1a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:12.307440 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f0857e2e-e67a-42f8-b4aa-24740b18fc1a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:12.314237 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0857e2e-e67a-42f8-b4aa-24740b18fc1a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:12.314681 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0857e2e-e67a-42f8-b4aa-24740b18fc1a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:12.315453 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0857e2e-e67a-42f8-b4aa-24740b18fc1a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:12.315881 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f0857e2e-e67a-42f8-b4aa-24740b18fc1a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:12.499405 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-caab9fb4-9afc-460e-ad39-a4c8656029f3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:12.502704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f0857e2e-e67a-42f8-b4aa-24740b18fc1a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:12.507321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-caab9fb4-9afc-460e-ad39-a4c8656029f3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1265 microversion: 2.1 time: 0.231307 Jun 03 13:12:12.507903 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 327/661] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:12 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:12.511028 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f0857e2e-e67a-42f8-b4aa-24740b18fc1a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:12.512534 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f0857e2e-e67a-42f8-b4aa-24740b18fc1a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:12.513693 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f0857e2e-e67a-42f8-b4aa-24740b18fc1a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1721 microversion: 2.20 time: 0.211233 Jun 03 13:12:12.514393 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 335/662] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:12 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:13.526312 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-336a3426-a99e-488c-b60c-f02f57e617e5 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:13.527072 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-336a3426-a99e-488c-b60c-f02f57e617e5 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:13.533530 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f11bf682-bb22-41b9-aff8-6afc5b1c428c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:13.534993 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f11bf682-bb22-41b9-aff8-6afc5b1c428c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:13.535752 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-336a3426-a99e-488c-b60c-f02f57e617e5 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:13.536310 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-336a3426-a99e-488c-b60c-f02f57e617e5 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:13.537465 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:13.537754 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-336a3426-a99e-488c-b60c-f02f57e617e5 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:13.538466 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-336a3426-a99e-488c-b60c-f02f57e617e5 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:13.538899 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=8 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:13.547984 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f11bf682-bb22-41b9-aff8-6afc5b1c428c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:13.548281 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f11bf682-bb22-41b9-aff8-6afc5b1c428c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:13.549257 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f11bf682-bb22-41b9-aff8-6afc5b1c428c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:13.549794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f11bf682-bb22-41b9-aff8-6afc5b1c428c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:13.744009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-336a3426-a99e-488c-b60c-f02f57e617e5 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:13.747519 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f11bf682-bb22-41b9-aff8-6afc5b1c428c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:13.751848 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-336a3426-a99e-488c-b60c-f02f57e617e5 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1265 microversion: 2.1 time: 0.230693 Jun 03 13:12:13.752429 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 328/663] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:13 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:13.755518 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f11bf682-bb22-41b9-aff8-6afc5b1c428c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:13.757417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f11bf682-bb22-41b9-aff8-6afc5b1c428c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:13.758604 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f11bf682-bb22-41b9-aff8-6afc5b1c428c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1721 microversion: 2.20 time: 0.229985 Jun 03 13:12:13.759225 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 336/664] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:13 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:14.769569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cf033cae-66df-42ec-ab69-1eb55da1b08f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:14.770239 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-cf033cae-66df-42ec-ab69-1eb55da1b08f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:14.776761 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1329a736-5e38-414c-b582-bc0f5482667c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:14.777433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1329a736-5e38-414c-b582-bc0f5482667c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:14.777560 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cf033cae-66df-42ec-ab69-1eb55da1b08f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:14.778031 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cf033cae-66df-42ec-ab69-1eb55da1b08f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:14.778865 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cf033cae-66df-42ec-ab69-1eb55da1b08f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:14.779272 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-cf033cae-66df-42ec-ab69-1eb55da1b08f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:14.784156 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1329a736-5e38-414c-b582-bc0f5482667c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:14.784615 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1329a736-5e38-414c-b582-bc0f5482667c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:14.785388 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1329a736-5e38-414c-b582-bc0f5482667c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:14.786031 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1329a736-5e38-414c-b582-bc0f5482667c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:14.979109 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-cf033cae-66df-42ec-ab69-1eb55da1b08f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:14.981767 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1329a736-5e38-414c-b582-bc0f5482667c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:14.986726 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cf033cae-66df-42ec-ab69-1eb55da1b08f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1265 microversion: 2.1 time: 0.221339 Jun 03 13:12:14.987295 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 329/665] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:14 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:14.990500 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1329a736-5e38-414c-b582-bc0f5482667c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:14.992277 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1329a736-5e38-414c-b582-bc0f5482667c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:14.993567 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1329a736-5e38-414c-b582-bc0f5482667c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1664 microversion: 2.20 time: 0.220757 Jun 03 13:12:14.994190 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 337/666] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:14 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1664 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:15.011090 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9ffa8b5c-7f62-4d32-847f-b1fcef5482fa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ced6b800-6c8c-466b-8e33-6426721dbedb"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:12:15.012274 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9ffa8b5c-7f62-4d32-847f-b1fcef5482fa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:15.018732 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ffa8b5c-7f62-4d32-847f-b1fcef5482fa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:15.019185 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ffa8b5c-7f62-4d32-847f-b1fcef5482fa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:15.019964 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ffa8b5c-7f62-4d32-847f-b1fcef5482fa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:15.020400 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9ffa8b5c-7f62-4d32-847f-b1fcef5482fa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:15.320984 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9ffa8b5c-7f62-4d32-847f-b1fcef5482fa tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "POST /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313697 Jun 03 13:12:15.321627 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 330/667] 10.222.0.58 () {62 vars in 1363 bytes} [Fri Jun 3 13:12:15 2022] POST /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/os-volume_attachments => generated 188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:12:15.444372 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-daa4f842-2a0e-4728-8c5d-41704119eda7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:12:15.445398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-daa4f842-2a0e-4728-8c5d-41704119eda7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:15.452182 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-daa4f842-2a0e-4728-8c5d-41704119eda7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:15.452667 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-daa4f842-2a0e-4728-8c5d-41704119eda7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:15.453439 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-daa4f842-2a0e-4728-8c5d-41704119eda7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:15.453870 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-daa4f842-2a0e-4728-8c5d-41704119eda7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:15.551293 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-daa4f842-2a0e-4728-8c5d-41704119eda7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "POST /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/action" status: 202 len: 0 microversion: 2.20 time: 0.111228 Jun 03 13:12:15.551904 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 338/668] 10.222.0.58 () {62 vars in 1318 bytes} [Fri Jun 3 13:12:15 2022] POST /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:12:15.560878 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8356714c-c52e-4bfc-be99-643efb18fa26 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:15.561498 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8356714c-c52e-4bfc-be99-643efb18fa26 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:15.568268 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8356714c-c52e-4bfc-be99-643efb18fa26 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:15.568718 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8356714c-c52e-4bfc-be99-643efb18fa26 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:15.569531 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8356714c-c52e-4bfc-be99-643efb18fa26 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:15.570002 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8356714c-c52e-4bfc-be99-643efb18fa26 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:15.704914 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8356714c-c52e-4bfc-be99-643efb18fa26 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:15.713879 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8356714c-c52e-4bfc-be99-643efb18fa26 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:15.715417 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8356714c-c52e-4bfc-be99-643efb18fa26 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:15.716590 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8356714c-c52e-4bfc-be99-643efb18fa26 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1750 microversion: 2.20 time: 0.159873 Jun 03 13:12:15.717158 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 331/669] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:15 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:16.005764 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-419166bb-1d88-4e45-b2f8-bd59e37c47ab tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:16.006502 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-419166bb-1d88-4e45-b2f8-bd59e37c47ab tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:16.016233 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-419166bb-1d88-4e45-b2f8-bd59e37c47ab tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:16.016894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-419166bb-1d88-4e45-b2f8-bd59e37c47ab tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:16.018154 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-419166bb-1d88-4e45-b2f8-bd59e37c47ab tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:16.019135 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-419166bb-1d88-4e45-b2f8-bd59e37c47ab tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:16.203638 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-419166bb-1d88-4e45-b2f8-bd59e37c47ab tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:16.211860 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-419166bb-1d88-4e45-b2f8-bd59e37c47ab tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1265 microversion: 2.1 time: 0.210597 Jun 03 13:12:16.212563 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 339/670] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:15 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:16.268046 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-d2c56230-9eab-4590-a5db-66ec932a45c5 req-a4747ece-1ffe-4b9b-b6d4-f7863a963acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4366f6f4-c8c3-4f29-af5e-94a09d9043d2", "name": "network-vif-plugged", "status": "completed", "tag": "4d7fd1c2-1a76-429a-9e14-45cde7f9a713"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:12:16.278504 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-d2c56230-9eab-4590-a5db-66ec932a45c5 req-a4747ece-1ffe-4b9b-b6d4-f7863a963acc service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:16.278997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-d2c56230-9eab-4590-a5db-66ec932a45c5 req-a4747ece-1ffe-4b9b-b6d4-f7863a963acc service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:16.292941 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-d2c56230-9eab-4590-a5db-66ec932a45c5 req-a4747ece-1ffe-4b9b-b6d4-f7863a963acc service nova] Creating event network-vif-plugged:4d7fd1c2-1a76-429a-9e14-45cde7f9a713 for instance 4366f6f4-c8c3-4f29-af5e-94a09d9043d2 on hv-cinder-77954 Jun 03 13:12:16.299754 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-d2c56230-9eab-4590-a5db-66ec932a45c5 req-a4747ece-1ffe-4b9b-b6d4-f7863a963acc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035506 Jun 03 13:12:16.300365 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 332/671] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:12:16.736181 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-51226d84-9110-4068-8d54-812c0a742760 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:16.736901 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-51226d84-9110-4068-8d54-812c0a742760 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:16.744419 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51226d84-9110-4068-8d54-812c0a742760 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:16.744909 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51226d84-9110-4068-8d54-812c0a742760 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:16.745719 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51226d84-9110-4068-8d54-812c0a742760 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:16.746175 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-51226d84-9110-4068-8d54-812c0a742760 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:16.889820 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-51226d84-9110-4068-8d54-812c0a742760 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:16.898624 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-51226d84-9110-4068-8d54-812c0a742760 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:16.900119 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-51226d84-9110-4068-8d54-812c0a742760 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:16.901306 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-51226d84-9110-4068-8d54-812c0a742760 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1752 microversion: 2.20 time: 0.169898 Jun 03 13:12:16.901860 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 340/672] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:16 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:17.229805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c930243f-92e9-4c84-ab56-706dd7da7e6a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:17.230479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c930243f-92e9-4c84-ab56-706dd7da7e6a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:17.236854 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c930243f-92e9-4c84-ab56-706dd7da7e6a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:17.237369 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c930243f-92e9-4c84-ab56-706dd7da7e6a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:17.238236 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c930243f-92e9-4c84-ab56-706dd7da7e6a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:17.238680 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c930243f-92e9-4c84-ab56-706dd7da7e6a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:17.379405 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c930243f-92e9-4c84-ab56-706dd7da7e6a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:17.390951 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c930243f-92e9-4c84-ab56-706dd7da7e6a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1265 microversion: 2.1 time: 0.165522 Jun 03 13:12:17.391845 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 333/673] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:17 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:17.921365 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e4727d2c-4706-4a6c-a7ce-e15148a79362 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:17.922056 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e4727d2c-4706-4a6c-a7ce-e15148a79362 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:17.930902 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4727d2c-4706-4a6c-a7ce-e15148a79362 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:17.931440 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4727d2c-4706-4a6c-a7ce-e15148a79362 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:17.932390 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4727d2c-4706-4a6c-a7ce-e15148a79362 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:17.932912 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4727d2c-4706-4a6c-a7ce-e15148a79362 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:18.122373 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e4727d2c-4706-4a6c-a7ce-e15148a79362 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:18.130965 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e4727d2c-4706-4a6c-a7ce-e15148a79362 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:18.132478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e4727d2c-4706-4a6c-a7ce-e15148a79362 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:18.133625 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e4727d2c-4706-4a6c-a7ce-e15148a79362 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.217102 Jun 03 13:12:18.134245 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 341/674] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:17 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:18.326660 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-22049de5-ecbb-4a92-839c-92ac8062e1c1 req-425afb3d-58d6-407f-b4ff-438a34839577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0321187a-23dc-4d94-a1d1-e341d8fdf035", "name": "network-vif-unplugged", "status": "completed", "tag": "1fae557f-ecd4-4f44-ad00-3f1f17914ef1"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:12:18.338720 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-22049de5-ecbb-4a92-839c-92ac8062e1c1 req-425afb3d-58d6-407f-b4ff-438a34839577 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:18.339155 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-22049de5-ecbb-4a92-839c-92ac8062e1c1 req-425afb3d-58d6-407f-b4ff-438a34839577 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:18.350592 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-22049de5-ecbb-4a92-839c-92ac8062e1c1 req-425afb3d-58d6-407f-b4ff-438a34839577 service nova] Creating event network-vif-unplugged:1fae557f-ecd4-4f44-ad00-3f1f17914ef1 for instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 on hv-cinder-77954 Jun 03 13:12:18.355422 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-22049de5-ecbb-4a92-839c-92ac8062e1c1 req-425afb3d-58d6-407f-b4ff-438a34839577 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035302 Jun 03 13:12:18.356021 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 334/675] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:12:18.409914 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5960bba7-be26-436f-a922-0e6a2166219f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:18.411574 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5960bba7-be26-436f-a922-0e6a2166219f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:18.418461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5960bba7-be26-436f-a922-0e6a2166219f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:18.418891 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5960bba7-be26-436f-a922-0e6a2166219f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:18.419678 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5960bba7-be26-436f-a922-0e6a2166219f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:18.420119 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5960bba7-be26-436f-a922-0e6a2166219f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:18.553745 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5960bba7-be26-436f-a922-0e6a2166219f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:18.562561 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5960bba7-be26-436f-a922-0e6a2166219f tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1453 microversion: 2.1 time: 0.157057 Jun 03 13:12:18.563088 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 342/676] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:18 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:18.579626 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-05d0c889-f84c-47bc-aa15-2a9ecbdd72ca tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:18.580395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-05d0c889-f84c-47bc-aa15-2a9ecbdd72ca tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:18.587312 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05d0c889-f84c-47bc-aa15-2a9ecbdd72ca tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:18.587738 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05d0c889-f84c-47bc-aa15-2a9ecbdd72ca tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:18.588505 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05d0c889-f84c-47bc-aa15-2a9ecbdd72ca tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:18.588937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05d0c889-f84c-47bc-aa15-2a9ecbdd72ca tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:18.607168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:18.779312 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-05d0c889-f84c-47bc-aa15-2a9ecbdd72ca tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:18.787234 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-05d0c889-f84c-47bc-aa15-2a9ecbdd72ca tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1453 microversion: 2.1 time: 0.212139 Jun 03 13:12:18.787831 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 335/677] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:18 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1453 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:19.152238 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-78b5e58e-6193-4a87-9b9d-7351672727ed tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:19.152888 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-78b5e58e-6193-4a87-9b9d-7351672727ed tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:19.159118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-78b5e58e-6193-4a87-9b9d-7351672727ed tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:19.159456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-78b5e58e-6193-4a87-9b9d-7351672727ed tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:19.160256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-78b5e58e-6193-4a87-9b9d-7351672727ed tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:19.160760 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-78b5e58e-6193-4a87-9b9d-7351672727ed tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:19.165362 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:19.465952 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-78b5e58e-6193-4a87-9b9d-7351672727ed tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:19.482757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-78b5e58e-6193-4a87-9b9d-7351672727ed tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:19.485762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-78b5e58e-6193-4a87-9b9d-7351672727ed tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:19.487677 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-78b5e58e-6193-4a87-9b9d-7351672727ed tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.340005 Jun 03 13:12:19.489367 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 343/678] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:19 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:20.509807 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-638a5868-1162-4868-a71f-cbf2c6475cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:20.511314 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-638a5868-1162-4868-a71f-cbf2c6475cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:20.525700 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-638a5868-1162-4868-a71f-cbf2c6475cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:20.526507 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-638a5868-1162-4868-a71f-cbf2c6475cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:20.527768 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-638a5868-1162-4868-a71f-cbf2c6475cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:20.528360 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-638a5868-1162-4868-a71f-cbf2c6475cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:20.736912 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-638a5868-1162-4868-a71f-cbf2c6475cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:20.750089 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-638a5868-1162-4868-a71f-cbf2c6475cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:20.751530 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-638a5868-1162-4868-a71f-cbf2c6475cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:20.759680 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-638a5868-1162-4868-a71f-cbf2c6475cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.256356 Jun 03 13:12:20.770990 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-3056cee5-1d1e-4c1e-8ef6-e1989ca43901 req-51f1e81d-c330-4010-b888-2f50917c7a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4366f6f4-c8c3-4f29-af5e-94a09d9043d2", "tag": "4d7fd1c2-1a76-429a-9e14-45cde7f9a713"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:12:20.771741 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 336/679] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:20 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:20.779796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-3056cee5-1d1e-4c1e-8ef6-e1989ca43901 req-51f1e81d-c330-4010-b888-2f50917c7a36 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:20.780374 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-3056cee5-1d1e-4c1e-8ef6-e1989ca43901 req-51f1e81d-c330-4010-b888-2f50917c7a36 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:20.792159 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-3056cee5-1d1e-4c1e-8ef6-e1989ca43901 req-51f1e81d-c330-4010-b888-2f50917c7a36 service nova] Creating event network-changed:4d7fd1c2-1a76-429a-9e14-45cde7f9a713 for instance 4366f6f4-c8c3-4f29-af5e-94a09d9043d2 on hv-cinder-77954 Jun 03 13:12:20.797938 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-3056cee5-1d1e-4c1e-8ef6-e1989ca43901 req-51f1e81d-c330-4010-b888-2f50917c7a36 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031369 Jun 03 13:12:20.799263 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 344/680] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:12:21.779334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-bfbe275c-8b1d-4e2e-9d62-a48937b319bc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:21.779953 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-bfbe275c-8b1d-4e2e-9d62-a48937b319bc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:21.786899 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfbe275c-8b1d-4e2e-9d62-a48937b319bc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:21.787347 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfbe275c-8b1d-4e2e-9d62-a48937b319bc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:21.788132 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfbe275c-8b1d-4e2e-9d62-a48937b319bc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:21.788750 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-bfbe275c-8b1d-4e2e-9d62-a48937b319bc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:21.943348 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bfbe275c-8b1d-4e2e-9d62-a48937b319bc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:21.952257 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bfbe275c-8b1d-4e2e-9d62-a48937b319bc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:21.953758 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-bfbe275c-8b1d-4e2e-9d62-a48937b319bc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:21.954953 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-bfbe275c-8b1d-4e2e-9d62-a48937b319bc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.180323 Jun 03 13:12:21.964115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 337/681] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:21 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:22.974058 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-217ff3ff-ed2b-4fc4-829c-0e652270247f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:22.974863 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-217ff3ff-ed2b-4fc4-829c-0e652270247f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:22.981838 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-217ff3ff-ed2b-4fc4-829c-0e652270247f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:22.982338 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-217ff3ff-ed2b-4fc4-829c-0e652270247f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:22.983119 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-217ff3ff-ed2b-4fc4-829c-0e652270247f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:22.983666 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-217ff3ff-ed2b-4fc4-829c-0e652270247f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:23.121370 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-217ff3ff-ed2b-4fc4-829c-0e652270247f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:23.131013 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-217ff3ff-ed2b-4fc4-829c-0e652270247f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:23.133340 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-217ff3ff-ed2b-4fc4-829c-0e652270247f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:23.134952 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-217ff3ff-ed2b-4fc4-829c-0e652270247f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.165649 Jun 03 13:12:23.135526 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 345/682] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:22 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:24.153438 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6c13c13a-af6e-4513-bef3-052d824de106 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:24.154175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6c13c13a-af6e-4513-bef3-052d824de106 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:24.161464 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c13c13a-af6e-4513-bef3-052d824de106 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:24.161914 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c13c13a-af6e-4513-bef3-052d824de106 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:24.162751 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c13c13a-af6e-4513-bef3-052d824de106 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:24.163175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c13c13a-af6e-4513-bef3-052d824de106 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:24.312591 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c13c13a-af6e-4513-bef3-052d824de106 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:24.323721 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c13c13a-af6e-4513-bef3-052d824de106 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:24.325218 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c13c13a-af6e-4513-bef3-052d824de106 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:24.326417 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6c13c13a-af6e-4513-bef3-052d824de106 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.177218 Jun 03 13:12:24.327206 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 338/683] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:24 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:25.346776 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-baa757eb-ad23-4528-91b6-f90fe6d1ca01 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:25.347390 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-baa757eb-ad23-4528-91b6-f90fe6d1ca01 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:25.355672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-baa757eb-ad23-4528-91b6-f90fe6d1ca01 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:25.355672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-baa757eb-ad23-4528-91b6-f90fe6d1ca01 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:25.355672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-baa757eb-ad23-4528-91b6-f90fe6d1ca01 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:25.356035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-baa757eb-ad23-4528-91b6-f90fe6d1ca01 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:25.496479 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-baa757eb-ad23-4528-91b6-f90fe6d1ca01 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:25.505723 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-baa757eb-ad23-4528-91b6-f90fe6d1ca01 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:25.507723 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-baa757eb-ad23-4528-91b6-f90fe6d1ca01 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:25.509369 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-baa757eb-ad23-4528-91b6-f90fe6d1ca01 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.166693 Jun 03 13:12:25.521147 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 346/684] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:25 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:26.531607 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4a346a55-bd59-4cb6-a013-05d2cc1d2a1e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:26.533102 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4a346a55-bd59-4cb6-a013-05d2cc1d2a1e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:26.543734 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a346a55-bd59-4cb6-a013-05d2cc1d2a1e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:26.544584 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a346a55-bd59-4cb6-a013-05d2cc1d2a1e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:26.546276 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a346a55-bd59-4cb6-a013-05d2cc1d2a1e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:26.546787 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a346a55-bd59-4cb6-a013-05d2cc1d2a1e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:26.688070 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4a346a55-bd59-4cb6-a013-05d2cc1d2a1e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:26.699910 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4a346a55-bd59-4cb6-a013-05d2cc1d2a1e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:26.701430 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4a346a55-bd59-4cb6-a013-05d2cc1d2a1e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:26.702727 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4a346a55-bd59-4cb6-a013-05d2cc1d2a1e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.177909 Jun 03 13:12:26.703573 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 339/685] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:26 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:27.721396 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6e91968d-4987-4d41-93f2-e369646eaf06 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:27.721950 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6e91968d-4987-4d41-93f2-e369646eaf06 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:27.728818 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e91968d-4987-4d41-93f2-e369646eaf06 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:27.729265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e91968d-4987-4d41-93f2-e369646eaf06 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:27.730022 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e91968d-4987-4d41-93f2-e369646eaf06 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:27.730483 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6e91968d-4987-4d41-93f2-e369646eaf06 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:27.885931 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6e91968d-4987-4d41-93f2-e369646eaf06 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:27.899023 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6e91968d-4987-4d41-93f2-e369646eaf06 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:27.900621 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6e91968d-4987-4d41-93f2-e369646eaf06 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:27.901824 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6e91968d-4987-4d41-93f2-e369646eaf06 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.184331 Jun 03 13:12:27.902422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 347/686] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:27 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:28.932218 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8aa9181c-bbde-4490-a0c8-648328adccb4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:28.933097 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8aa9181c-bbde-4490-a0c8-648328adccb4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:28.944773 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8aa9181c-bbde-4490-a0c8-648328adccb4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:28.945223 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8aa9181c-bbde-4490-a0c8-648328adccb4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:28.946005 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8aa9181c-bbde-4490-a0c8-648328adccb4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:28.946473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8aa9181c-bbde-4490-a0c8-648328adccb4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:29.080664 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8aa9181c-bbde-4490-a0c8-648328adccb4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:29.089753 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8aa9181c-bbde-4490-a0c8-648328adccb4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:29.091842 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8aa9181c-bbde-4490-a0c8-648328adccb4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:29.092501 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8aa9181c-bbde-4490-a0c8-648328adccb4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.167463 Jun 03 13:12:29.093038 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 340/687] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:28 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:30.115062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f053093f-bab5-4887-b797-e2f628550049 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:30.116043 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f053093f-bab5-4887-b797-e2f628550049 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:30.123666 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f053093f-bab5-4887-b797-e2f628550049 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:30.124115 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f053093f-bab5-4887-b797-e2f628550049 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:30.124881 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f053093f-bab5-4887-b797-e2f628550049 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:30.125313 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f053093f-bab5-4887-b797-e2f628550049 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:30.259224 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f053093f-bab5-4887-b797-e2f628550049 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:30.267747 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f053093f-bab5-4887-b797-e2f628550049 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:30.269263 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f053093f-bab5-4887-b797-e2f628550049 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:30.270472 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f053093f-bab5-4887-b797-e2f628550049 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.162444 Jun 03 13:12:30.271040 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 348/688] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:30 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:31.291698 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8d91d51c-4244-4a2f-8ed0-be7d5de7ddda tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:31.292301 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8d91d51c-4244-4a2f-8ed0-be7d5de7ddda tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:31.299188 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d91d51c-4244-4a2f-8ed0-be7d5de7ddda tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:31.299633 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d91d51c-4244-4a2f-8ed0-be7d5de7ddda tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:31.300394 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d91d51c-4244-4a2f-8ed0-be7d5de7ddda tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:31.300801 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8d91d51c-4244-4a2f-8ed0-be7d5de7ddda tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:31.447459 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8d91d51c-4244-4a2f-8ed0-be7d5de7ddda tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:31.460930 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8d91d51c-4244-4a2f-8ed0-be7d5de7ddda tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:31.462772 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8d91d51c-4244-4a2f-8ed0-be7d5de7ddda tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:31.464323 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8d91d51c-4244-4a2f-8ed0-be7d5de7ddda tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.177701 Jun 03 13:12:31.464864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 341/689] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:31 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:32.483337 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b26c9967-be72-496e-800b-1a6b1c7aaffc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:32.483920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b26c9967-be72-496e-800b-1a6b1c7aaffc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:32.490960 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b26c9967-be72-496e-800b-1a6b1c7aaffc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:32.491411 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b26c9967-be72-496e-800b-1a6b1c7aaffc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:32.492186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b26c9967-be72-496e-800b-1a6b1c7aaffc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:32.493327 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b26c9967-be72-496e-800b-1a6b1c7aaffc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:32.629815 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b26c9967-be72-496e-800b-1a6b1c7aaffc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:32.639110 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b26c9967-be72-496e-800b-1a6b1c7aaffc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:32.640600 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b26c9967-be72-496e-800b-1a6b1c7aaffc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:32.641764 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b26c9967-be72-496e-800b-1a6b1c7aaffc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.162474 Jun 03 13:12:32.642354 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 349/690] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:32 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:32.990237 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b4064315-f92d-4989-b76d-ad9fa662b63b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:32.990890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b4064315-f92d-4989-b76d-ad9fa662b63b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:32.998226 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b4064315-f92d-4989-b76d-ad9fa662b63b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:32.998672 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b4064315-f92d-4989-b76d-ad9fa662b63b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:32.999469 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b4064315-f92d-4989-b76d-ad9fa662b63b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:32.999929 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b4064315-f92d-4989-b76d-ad9fa662b63b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:33.025570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b4064315-f92d-4989-b76d-ad9fa662b63b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/ips" status: 200 len: 150 microversion: 2.1 time: 0.039634 Jun 03 13:12:33.026159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 342/691] 10.222.0.58 () {58 vars in 1247 bytes} [Fri Jun 3 13:12:32 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:12:33.661967 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c3d81769-5562-4e82-a74f-e8bdc9396d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:33.662673 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c3d81769-5562-4e82-a74f-e8bdc9396d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:33.670459 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3d81769-5562-4e82-a74f-e8bdc9396d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:33.670915 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3d81769-5562-4e82-a74f-e8bdc9396d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:33.671738 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3d81769-5562-4e82-a74f-e8bdc9396d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:33.672169 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c3d81769-5562-4e82-a74f-e8bdc9396d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:33.810906 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c3d81769-5562-4e82-a74f-e8bdc9396d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:33.819909 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c3d81769-5562-4e82-a74f-e8bdc9396d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:33.821963 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c3d81769-5562-4e82-a74f-e8bdc9396d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:33.823157 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c3d81769-5562-4e82-a74f-e8bdc9396d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.167896 Jun 03 13:12:33.823724 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 350/692] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:33 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:34.376862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-56a80b90-4447-4de7-85e2-0bfa37723aa1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "138532c0-d7d3-490e-8307-204558a78ac8"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:12:34.377947 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-56a80b90-4447-4de7-85e2-0bfa37723aa1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:34.385042 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56a80b90-4447-4de7-85e2-0bfa37723aa1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:34.385496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56a80b90-4447-4de7-85e2-0bfa37723aa1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:34.386305 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56a80b90-4447-4de7-85e2-0bfa37723aa1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:34.386743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56a80b90-4447-4de7-85e2-0bfa37723aa1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:34.654044 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-56a80b90-4447-4de7-85e2-0bfa37723aa1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "POST /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281053 Jun 03 13:12:34.654704 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 343/693] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:12:34 2022] POST /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:12:34.846545 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b5c355a4-3156-49a7-b103-9a325df01283 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:34.847114 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b5c355a4-3156-49a7-b103-9a325df01283 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:34.854058 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5c355a4-3156-49a7-b103-9a325df01283 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:34.854547 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5c355a4-3156-49a7-b103-9a325df01283 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:34.855327 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5c355a4-3156-49a7-b103-9a325df01283 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:34.855767 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b5c355a4-3156-49a7-b103-9a325df01283 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:34.995417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b5c355a4-3156-49a7-b103-9a325df01283 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:35.004529 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b5c355a4-3156-49a7-b103-9a325df01283 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:35.006148 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b5c355a4-3156-49a7-b103-9a325df01283 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:35.007440 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b5c355a4-3156-49a7-b103-9a325df01283 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.164949 Jun 03 13:12:35.007982 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 351/694] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:34 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:36.028954 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b3467f6f-5f1f-4e13-8a40-8f1200a29b4f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:36.029690 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b3467f6f-5f1f-4e13-8a40-8f1200a29b4f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:36.031803 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=44 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:36.038348 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3467f6f-5f1f-4e13-8a40-8f1200a29b4f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:36.038816 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3467f6f-5f1f-4e13-8a40-8f1200a29b4f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:36.039635 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3467f6f-5f1f-4e13-8a40-8f1200a29b4f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:36.040105 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b3467f6f-5f1f-4e13-8a40-8f1200a29b4f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:36.433468 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b3467f6f-5f1f-4e13-8a40-8f1200a29b4f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:36.444734 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b3467f6f-5f1f-4e13-8a40-8f1200a29b4f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:36.447252 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b3467f6f-5f1f-4e13-8a40-8f1200a29b4f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:36.448569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b3467f6f-5f1f-4e13-8a40-8f1200a29b4f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.425396 Jun 03 13:12:36.449134 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 344/695] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:36 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:37.477023 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8a159320-b7a3-468b-af42-6ad2bbdb7573 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:37.478053 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8a159320-b7a3-468b-af42-6ad2bbdb7573 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:37.483747 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=46 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:37.493056 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a159320-b7a3-468b-af42-6ad2bbdb7573 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:37.493794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a159320-b7a3-468b-af42-6ad2bbdb7573 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:37.494864 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a159320-b7a3-468b-af42-6ad2bbdb7573 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:37.495290 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a159320-b7a3-468b-af42-6ad2bbdb7573 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:37.631239 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8a159320-b7a3-468b-af42-6ad2bbdb7573 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:37.644316 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8a159320-b7a3-468b-af42-6ad2bbdb7573 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:37.646762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8a159320-b7a3-468b-af42-6ad2bbdb7573 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:37.648540 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8a159320-b7a3-468b-af42-6ad2bbdb7573 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.178039 Jun 03 13:12:37.649300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 352/696] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:37 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:38.670175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-83329b32-2e73-4006-b848-fb74257fee4d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:38.670888 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-83329b32-2e73-4006-b848-fb74257fee4d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:38.679601 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83329b32-2e73-4006-b848-fb74257fee4d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:38.680157 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83329b32-2e73-4006-b848-fb74257fee4d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:38.681291 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83329b32-2e73-4006-b848-fb74257fee4d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:38.682234 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-83329b32-2e73-4006-b848-fb74257fee4d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:38.834042 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-83329b32-2e73-4006-b848-fb74257fee4d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:38.843377 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-83329b32-2e73-4006-b848-fb74257fee4d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:38.844840 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-83329b32-2e73-4006-b848-fb74257fee4d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:38.846040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-83329b32-2e73-4006-b848-fb74257fee4d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.181660 Jun 03 13:12:38.846643 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 345/697] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:38 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:39.869706 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-37382a29-1124-4f23-9869-029d33cb54e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:39.870306 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-37382a29-1124-4f23-9869-029d33cb54e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:39.877219 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37382a29-1124-4f23-9869-029d33cb54e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:39.877677 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37382a29-1124-4f23-9869-029d33cb54e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:39.878503 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37382a29-1124-4f23-9869-029d33cb54e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:39.878948 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37382a29-1124-4f23-9869-029d33cb54e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:40.020958 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-37382a29-1124-4f23-9869-029d33cb54e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:40.029838 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-37382a29-1124-4f23-9869-029d33cb54e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:40.031388 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-37382a29-1124-4f23-9869-029d33cb54e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:40.032560 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-37382a29-1124-4f23-9869-029d33cb54e7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.170208 Jun 03 13:12:40.033117 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 353/698] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:39 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:41.050950 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e9ed8539-43ac-4056-8a01-9fb76f4a73cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:41.051538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e9ed8539-43ac-4056-8a01-9fb76f4a73cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:41.059252 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9ed8539-43ac-4056-8a01-9fb76f4a73cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:41.059693 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9ed8539-43ac-4056-8a01-9fb76f4a73cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:41.060535 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9ed8539-43ac-4056-8a01-9fb76f4a73cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:41.061025 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9ed8539-43ac-4056-8a01-9fb76f4a73cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:41.201155 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e9ed8539-43ac-4056-8a01-9fb76f4a73cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:41.209990 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e9ed8539-43ac-4056-8a01-9fb76f4a73cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:41.211610 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e9ed8539-43ac-4056-8a01-9fb76f4a73cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:41.212857 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e9ed8539-43ac-4056-8a01-9fb76f4a73cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.165841 Jun 03 13:12:41.213504 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 346/699] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:41 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:42.231413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-062a6201-82e3-4955-8f3c-eb77ce966fa7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:42.232433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-062a6201-82e3-4955-8f3c-eb77ce966fa7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:42.239851 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-062a6201-82e3-4955-8f3c-eb77ce966fa7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:42.240293 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-062a6201-82e3-4955-8f3c-eb77ce966fa7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:42.241082 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-062a6201-82e3-4955-8f3c-eb77ce966fa7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:42.241512 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-062a6201-82e3-4955-8f3c-eb77ce966fa7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:42.323965 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-47621072-c83b-4511-8310-c7b5efa1ca37 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:42.325176 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-47621072-c83b-4511-8310-c7b5efa1ca37 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:42.332943 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47621072-c83b-4511-8310-c7b5efa1ca37 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:42.333449 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47621072-c83b-4511-8310-c7b5efa1ca37 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:42.334371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47621072-c83b-4511-8310-c7b5efa1ca37 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:42.334907 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47621072-c83b-4511-8310-c7b5efa1ca37 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:42.380032 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-062a6201-82e3-4955-8f3c-eb77ce966fa7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:42.388936 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-062a6201-82e3-4955-8f3c-eb77ce966fa7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:42.390708 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-062a6201-82e3-4955-8f3c-eb77ce966fa7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:42.392240 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-062a6201-82e3-4955-8f3c-eb77ce966fa7 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.164879 Jun 03 13:12:42.392710 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 354/700] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:42 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:42.404329 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-dd2e36e7-28d7-475f-926e-00e3b60b4d67 req-71517fce-4950-4450-8799-ec43703329ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0321187a-23dc-4d94-a1d1-e341d8fdf035", "name": "network-vif-plugged", "status": "completed", "tag": "1fae557f-ecd4-4f44-ad00-3f1f17914ef1"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:12:42.413033 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-dd2e36e7-28d7-475f-926e-00e3b60b4d67 req-71517fce-4950-4450-8799-ec43703329ce service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:42.413726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-dd2e36e7-28d7-475f-926e-00e3b60b4d67 req-71517fce-4950-4450-8799-ec43703329ce service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:42.429393 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-47621072-c83b-4511-8310-c7b5efa1ca37 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lazy-loading 'services' on Instance uuid 81458192-c1e4-464b-916a-dbba42252d64 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:12:42.430766 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-dd2e36e7-28d7-475f-926e-00e3b60b4d67 req-71517fce-4950-4450-8799-ec43703329ce service nova] Creating event network-vif-plugged:1fae557f-ecd4-4f44-ad00-3f1f17914ef1 for instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 on hv-cinder-77954 Jun 03 13:12:42.436448 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-dd2e36e7-28d7-475f-926e-00e3b60b4d67 req-71517fce-4950-4450-8799-ec43703329ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036232 Jun 03 13:12:42.437443 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 355/701] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:12:42.512154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-47621072-c83b-4511-8310-c7b5efa1ca37 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/os-volume_attachments/138532c0-d7d3-490e-8307-204558a78ac8" status: 202 len: 0 microversion: 2.1 time: 0.192296 Jun 03 13:12:42.512747 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 347/702] 10.222.0.58 () {58 vars in 1415 bytes} [Fri Jun 3 13:12:42 2022] DELETE /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/os-volume_attachments/138532c0-d7d3-490e-8307-204558a78ac8 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 13:12:42.521720 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cd067e26-097b-4728-a953-d55e63387b1b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:42.523511 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cd067e26-097b-4728-a953-d55e63387b1b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:42.533685 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cd067e26-097b-4728-a953-d55e63387b1b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:42.534143 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cd067e26-097b-4728-a953-d55e63387b1b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:42.534927 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cd067e26-097b-4728-a953-d55e63387b1b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:42.535356 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cd067e26-097b-4728-a953-d55e63387b1b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:42.565449 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cd067e26-097b-4728-a953-d55e63387b1b tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048083 Jun 03 13:12:42.565997 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 356/703] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:12:42 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:12:43.417718 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-930be426-461c-449d-b167-1fcf5ab929cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:43.419318 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-930be426-461c-449d-b167-1fcf5ab929cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:43.429791 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-930be426-461c-449d-b167-1fcf5ab929cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:43.430607 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-930be426-461c-449d-b167-1fcf5ab929cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:43.431887 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-930be426-461c-449d-b167-1fcf5ab929cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:43.432700 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-930be426-461c-449d-b167-1fcf5ab929cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:43.577287 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6100d7c3-b488-4ad9-acc1-77a3e9a262f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:43.578275 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6100d7c3-b488-4ad9-acc1-77a3e9a262f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:43.578914 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-930be426-461c-449d-b167-1fcf5ab929cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:43.586719 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6100d7c3-b488-4ad9-acc1-77a3e9a262f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:43.587393 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6100d7c3-b488-4ad9-acc1-77a3e9a262f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:43.587925 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-930be426-461c-449d-b167-1fcf5ab929cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:43.588557 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6100d7c3-b488-4ad9-acc1-77a3e9a262f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:43.589329 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6100d7c3-b488-4ad9-acc1-77a3e9a262f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:43.589575 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-930be426-461c-449d-b167-1fcf5ab929cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:43.590783 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-930be426-461c-449d-b167-1fcf5ab929cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.181619 Jun 03 13:12:43.591347 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 348/704] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:43 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:43.623051 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6100d7c3-b488-4ad9-acc1-77a3e9a262f7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049783 Jun 03 13:12:43.623622 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 357/705] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:12:43 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:12:44.609573 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-052d4b79-dc4b-4424-b108-b1ba40eb5fb5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:44.610237 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-052d4b79-dc4b-4424-b108-b1ba40eb5fb5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:44.617598 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-052d4b79-dc4b-4424-b108-b1ba40eb5fb5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:44.618049 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-052d4b79-dc4b-4424-b108-b1ba40eb5fb5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:44.618855 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-052d4b79-dc4b-4424-b108-b1ba40eb5fb5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:44.619288 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-052d4b79-dc4b-4424-b108-b1ba40eb5fb5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:44.634811 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9ca749fe-d510-409e-aff5-1ca48acfd4a0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:44.636130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9ca749fe-d510-409e-aff5-1ca48acfd4a0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:44.643030 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ca749fe-d510-409e-aff5-1ca48acfd4a0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:44.643491 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ca749fe-d510-409e-aff5-1ca48acfd4a0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:44.644285 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ca749fe-d510-409e-aff5-1ca48acfd4a0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:44.644726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9ca749fe-d510-409e-aff5-1ca48acfd4a0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:44.674132 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9ca749fe-d510-409e-aff5-1ca48acfd4a0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043196 Jun 03 13:12:44.674675 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 358/706] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:12:44 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:12:44.733579 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bb22b507-4763-47ee-8db4-b3d96d891c1c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:44.734323 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bb22b507-4763-47ee-8db4-b3d96d891c1c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:44.741024 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bb22b507-4763-47ee-8db4-b3d96d891c1c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:44.741557 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bb22b507-4763-47ee-8db4-b3d96d891c1c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:44.742380 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bb22b507-4763-47ee-8db4-b3d96d891c1c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:44.742819 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bb22b507-4763-47ee-8db4-b3d96d891c1c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:44.754689 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-052d4b79-dc4b-4424-b108-b1ba40eb5fb5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:44.764086 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-052d4b79-dc4b-4424-b108-b1ba40eb5fb5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:44.765585 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-052d4b79-dc4b-4424-b108-b1ba40eb5fb5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:44.766883 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-052d4b79-dc4b-4424-b108-b1ba40eb5fb5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.161381 Jun 03 13:12:44.767449 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 349/707] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:44 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:44.768420 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bb22b507-4763-47ee-8db4-b3d96d891c1c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:12:44.819745 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:44.856966 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bb22b507-4763-47ee-8db4-b3d96d891c1c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 204 len: 0 microversion: 2.1 time: 0.127080 Jun 03 13:12:44.857557 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 359/708] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:12:44 2022] DELETE /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:12:44.866241 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f0b9b585-7e8b-493d-84d0-bcf4228db26d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:44.866859 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f0b9b585-7e8b-493d-84d0-bcf4228db26d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:44.873612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0b9b585-7e8b-493d-84d0-bcf4228db26d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:44.874063 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0b9b585-7e8b-493d-84d0-bcf4228db26d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:44.874869 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0b9b585-7e8b-493d-84d0-bcf4228db26d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:44.875303 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f0b9b585-7e8b-493d-84d0-bcf4228db26d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:44.893386 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:12:45.007248 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f0b9b585-7e8b-493d-84d0-bcf4228db26d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:45.015503 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f0b9b585-7e8b-493d-84d0-bcf4228db26d tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1682 microversion: 2.1 time: 0.153556 Jun 03 13:12:45.016073 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 350/709] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:44 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:45.789652 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f50a924-50c8-4715-93e1-f0539a7e0019 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:45.790956 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7f50a924-50c8-4715-93e1-f0539a7e0019 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:45.802713 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f50a924-50c8-4715-93e1-f0539a7e0019 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:45.803469 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f50a924-50c8-4715-93e1-f0539a7e0019 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:45.804748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f50a924-50c8-4715-93e1-f0539a7e0019 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:45.805499 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f50a924-50c8-4715-93e1-f0539a7e0019 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:45.952940 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7f50a924-50c8-4715-93e1-f0539a7e0019 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:45.964983 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7f50a924-50c8-4715-93e1-f0539a7e0019 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:45.966949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7f50a924-50c8-4715-93e1-f0539a7e0019 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:45.968769 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7f50a924-50c8-4715-93e1-f0539a7e0019 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1808 microversion: 2.20 time: 0.186277 Jun 03 13:12:45.969575 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 360/710] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:45 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:46.038501 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4e60ce29-4017-49fe-88c8-c0f960868b27 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:46.039508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4e60ce29-4017-49fe-88c8-c0f960868b27 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:46.047928 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4e60ce29-4017-49fe-88c8-c0f960868b27 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:46.048380 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4e60ce29-4017-49fe-88c8-c0f960868b27 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:46.049154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4e60ce29-4017-49fe-88c8-c0f960868b27 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:46.049588 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4e60ce29-4017-49fe-88c8-c0f960868b27 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:46.179909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4e60ce29-4017-49fe-88c8-c0f960868b27 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:46.188195 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4e60ce29-4017-49fe-88c8-c0f960868b27 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1682 microversion: 2.1 time: 0.156608 Jun 03 13:12:46.188768 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 351/711] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:46 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:46.997604 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b491d32b-39b9-43ed-afa6-c5b1109aaa4c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:46.998652 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b491d32b-39b9-43ed-afa6-c5b1109aaa4c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:47.009604 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b491d32b-39b9-43ed-afa6-c5b1109aaa4c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:47.010378 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b491d32b-39b9-43ed-afa6-c5b1109aaa4c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:47.011837 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b491d32b-39b9-43ed-afa6-c5b1109aaa4c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:47.012283 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b491d32b-39b9-43ed-afa6-c5b1109aaa4c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:47.145878 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b491d32b-39b9-43ed-afa6-c5b1109aaa4c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:47.154768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b491d32b-39b9-43ed-afa6-c5b1109aaa4c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:47.156294 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b491d32b-39b9-43ed-afa6-c5b1109aaa4c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:47.157471 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b491d32b-39b9-43ed-afa6-c5b1109aaa4c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1795 microversion: 2.20 time: 0.166727 Jun 03 13:12:47.158028 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 361/712] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:12:46 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1795 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:12:47.205103 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-43d48bce-f44a-47a7-b8d1-67162f0232f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:47.205763 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-43d48bce-f44a-47a7-b8d1-67162f0232f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:47.212641 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43d48bce-f44a-47a7-b8d1-67162f0232f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:47.213091 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43d48bce-f44a-47a7-b8d1-67162f0232f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:47.214092 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43d48bce-f44a-47a7-b8d1-67162f0232f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:47.214530 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-43d48bce-f44a-47a7-b8d1-67162f0232f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:47.348469 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-43d48bce-f44a-47a7-b8d1-67162f0232f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:47.356359 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-43d48bce-f44a-47a7-b8d1-67162f0232f4 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1682 microversion: 2.1 time: 0.155265 Jun 03 13:12:47.356947 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 352/713] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:47 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:47.960792 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-efa0104f-4550-496f-b9fe-74b43ae1484e req-bc3cf958-27a9-442a-9b3d-7cff06bde617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81458192-c1e4-464b-916a-dbba42252d64", "name": "network-vif-deleted", "tag": "b0b7c562-0e9c-4a53-b571-448df6f49db9"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:12:47.971344 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-efa0104f-4550-496f-b9fe-74b43ae1484e req-bc3cf958-27a9-442a-9b3d-7cff06bde617 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:47.971795 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-efa0104f-4550-496f-b9fe-74b43ae1484e req-bc3cf958-27a9-442a-9b3d-7cff06bde617 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:47.985307 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-efa0104f-4550-496f-b9fe-74b43ae1484e req-bc3cf958-27a9-442a-9b3d-7cff06bde617 service nova] Creating event network-vif-deleted:b0b7c562-0e9c-4a53-b571-448df6f49db9 for instance 81458192-c1e4-464b-916a-dbba42252d64 on hv-cinder-77954 Jun 03 13:12:47.992576 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-efa0104f-4550-496f-b9fe-74b43ae1484e req-bc3cf958-27a9-442a-9b3d-7cff06bde617 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034526 Jun 03 13:12:47.993588 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 362/714] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:12:48.374966 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9a587980-bd8d-40b7-8c68-667ec36966c6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:48.375709 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9a587980-bd8d-40b7-8c68-667ec36966c6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:48.382975 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a587980-bd8d-40b7-8c68-667ec36966c6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:48.383658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a587980-bd8d-40b7-8c68-667ec36966c6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:48.384754 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a587980-bd8d-40b7-8c68-667ec36966c6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:48.385261 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a587980-bd8d-40b7-8c68-667ec36966c6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:48.422676 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a587980-bd8d-40b7-8c68-667ec36966c6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:48.423371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a587980-bd8d-40b7-8c68-667ec36966c6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:48.423980 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-9a587980-bd8d-40b7-8c68-667ec36966c6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lazy-loading 'fault' on Instance uuid 81458192-c1e4-464b-916a-dbba42252d64 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:12:48.468358 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9a587980-bd8d-40b7-8c68-667ec36966c6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2217b3c134d453fbdcb14853eed4e3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6cc7be84d074c319f6c2d8628e76f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:12:48.476032 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9a587980-bd8d-40b7-8c68-667ec36966c6 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 200 len: 1332 microversion: 2.1 time: 0.105633 Jun 03 13:12:48.476605 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 353/715] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:48 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:12:49.496716 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b421f345-ba58-41b2-b984-de32dc4a9fb0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:49.497423 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b421f345-ba58-41b2-b984-de32dc4a9fb0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:49.504313 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b421f345-ba58-41b2-b984-de32dc4a9fb0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:49.504770 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b421f345-ba58-41b2-b984-de32dc4a9fb0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:49.505549 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b421f345-ba58-41b2-b984-de32dc4a9fb0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:49.505997 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b421f345-ba58-41b2-b984-de32dc4a9fb0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:49.519587 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-b421f345-ba58-41b2-b984-de32dc4a9fb0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b421f345-ba58-41b2-b984-de32dc4a9fb0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 HTTP/1.1 Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:12:49.521211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:12:49.522699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:12:49.522699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:49.522699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:49.522699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:49.522699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:49.522699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:12:49.522699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:12:49.522699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:12:49.522699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:49.522699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:12:49.522699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:49.522699 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '81458192-c1e4-464b-916a-dbba42252d64'} Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:12:49.523478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:49.524894 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:49.526827 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b421f345-ba58-41b2-b984-de32dc4a9fb0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 404 to user: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:12:49.526827 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b421f345-ba58-41b2-b984-de32dc4a9fb0 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 404 len: 111 microversion: 2.1 time: 0.031787 Jun 03 13:12:49.526827 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 363/716] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:49 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:12:49.531897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cae45b2e-95b2-43b0-9453-712a8051d64f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '.version_select at 0x7fc5a4b9a4c0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:49.552674 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cae45b2e-95b2-43b0-9453-712a8051d64f tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693654086" status: 202 len: 0 microversion: 2.1 time: 0.024627 Jun 03 13:12:49.553255 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 354/717] 10.222.0.58 () {58 vars in 1220 bytes} [Fri Jun 3 13:12:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693654086 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:12:51.342308 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bbf64c62-289e-4557-b388-cde5c8ecbd43 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:51.342807 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bbf64c62-289e-4557-b388-cde5c8ecbd43 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:51.349723 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbf64c62-289e-4557-b388-cde5c8ecbd43 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:51.350231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbf64c62-289e-4557-b388-cde5c8ecbd43 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:51.350990 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbf64c62-289e-4557-b388-cde5c8ecbd43 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:51.351431 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbf64c62-289e-4557-b388-cde5c8ecbd43 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:51.366387 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-bbf64c62-289e-4557-b388-cde5c8ecbd43 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bbf64c62-289e-4557-b388-cde5c8ecbd43 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 HTTP/1.1 Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:12:51.367919 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:12:51.369413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:12:51.369413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:51.369413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:51.369413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:51.369413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:51.369413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:12:51.369413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:12:51.369413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:12:51.369413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:51.369413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:12:51.369413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:51.369413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '81458192-c1e4-464b-916a-dbba42252d64'} Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:12:51.370324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:51.371704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:51.373136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bbf64c62-289e-4557-b388-cde5c8ecbd43 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 404 to user: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:12:51.373136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bbf64c62-289e-4557-b388-cde5c8ecbd43 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 404 len: 111 microversion: 2.1 time: 0.030981 Jun 03 13:12:51.373136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 364/718] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:12:51 2022] DELETE /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:12:51.379032 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-452cca5c-2749-4872-b21a-0ecd743391c7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:51.379689 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-452cca5c-2749-4872-b21a-0ecd743391c7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 81458192-c1e4-464b-916a-dbba42252d64] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:51.386752 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-452cca5c-2749-4872-b21a-0ecd743391c7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:51.387296 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-452cca5c-2749-4872-b21a-0ecd743391c7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:51.388070 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-452cca5c-2749-4872-b21a-0ecd743391c7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:51.388510 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-452cca5c-2749-4872-b21a-0ecd743391c7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:51.401485 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-452cca5c-2749-4872-b21a-0ecd743391c7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-452cca5c-2749-4872-b21a-0ecd743391c7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 HTTP/1.1 Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:12:51.403156 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:12:51.404729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:12:51.404729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:51.404729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:51.404729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:51.404729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:51.404729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:12:51.404729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:12:51.404729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:12:51.404729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:51.404729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:12:51.404729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:51.404729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '81458192-c1e4-464b-916a-dbba42252d64'} Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:12:51.405561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. Jun 03 13:12:51.406778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:51.407850 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-452cca5c-2749-4872-b21a-0ecd743391c7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 404 to user: Instance 81458192-c1e4-464b-916a-dbba42252d64 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:12:51.407850 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-452cca5c-2749-4872-b21a-0ecd743391c7 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64" status: 404 len: 111 microversion: 2.1 time: 0.030160 Jun 03 13:12:51.407850 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 355/719] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:51 2022] GET /compute/v2.1/servers/81458192-c1e4-464b-916a-dbba42252d64 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:12:52.546185 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-141ffb8a-0157-485c-90dc-8df896a76168 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:52.546781 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-141ffb8a-0157-485c-90dc-8df896a76168 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:52.553976 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-141ffb8a-0157-485c-90dc-8df896a76168 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:52.554465 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-141ffb8a-0157-485c-90dc-8df896a76168 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:52.555248 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-141ffb8a-0157-485c-90dc-8df896a76168 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:52.555686 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-141ffb8a-0157-485c-90dc-8df896a76168 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:52.570018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-141ffb8a-0157-485c-90dc-8df896a76168 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-141ffb8a-0157-485c-90dc-8df896a76168 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e HTTP/1.1 Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:12:52.571607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:12:52.572977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:12:52.572977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:52.572977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:52.572977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:52.572977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:52.572977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:12:52.572977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:12:52.572977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:12:52.572977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:52.572977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:12:52.572977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:12:52.572977 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '328fcefb-287f-49d4-b35e-69edc918861e'} Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:12:52.573748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:12:52.575102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.576661 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-141ffb8a-0157-485c-90dc-8df896a76168 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 404 to user: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:12:52.576661 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-141ffb8a-0157-485c-90dc-8df896a76168 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 404 len: 111 microversion: 2.1 time: 0.031085 Jun 03 13:12:52.576661 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 365/720] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:12:52 2022] DELETE /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:12:52.581896 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e338bf40-f306-48a8-8d60-b52bf428a152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:52.582539 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e338bf40-f306-48a8-8d60-b52bf428a152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 328fcefb-287f-49d4-b35e-69edc918861e] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:52.589255 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e338bf40-f306-48a8-8d60-b52bf428a152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:52.589684 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e338bf40-f306-48a8-8d60-b52bf428a152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:52.590511 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e338bf40-f306-48a8-8d60-b52bf428a152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:52.590949 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e338bf40-f306-48a8-8d60-b52bf428a152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:52.604815 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-e338bf40-f306-48a8-8d60-b52bf428a152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e338bf40-f306-48a8-8d60-b52bf428a152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e HTTP/1.1 Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:12:52.606381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:12:52.607890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:12:52.607890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:52.607890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:52.607890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:52.607890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:52.607890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:12:52.607890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:12:52.607890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:12:52.607890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:52.607890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:12:52.607890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:12:52.607890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '328fcefb-287f-49d4-b35e-69edc918861e'} Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:12:52.609099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. Jun 03 13:12:52.610567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.611915 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e338bf40-f306-48a8-8d60-b52bf428a152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 404 to user: Instance 328fcefb-287f-49d4-b35e-69edc918861e could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:12:52.611915 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e338bf40-f306-48a8-8d60-b52bf428a152 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e" status: 404 len: 111 microversion: 2.1 time: 0.029814 Jun 03 13:12:52.611915 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 356/721] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:52 2022] GET /compute/v2.1/servers/328fcefb-287f-49d4-b35e-69edc918861e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:12:52.616907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-60ab4118-1eac-4271-aa48-914c36151a0c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:52.617397 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-60ab4118-1eac-4271-aa48-914c36151a0c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:52.623847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60ab4118-1eac-4271-aa48-914c36151a0c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:52.624514 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60ab4118-1eac-4271-aa48-914c36151a0c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:52.625279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60ab4118-1eac-4271-aa48-914c36151a0c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:52.625711 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-60ab4118-1eac-4271-aa48-914c36151a0c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:52.640084 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-60ab4118-1eac-4271-aa48-914c36151a0c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-60ab4118-1eac-4271-aa48-914c36151a0c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f HTTP/1.1 Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:12:52.641801 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:12:52.643452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:12:52.643452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:52.643452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:52.643452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:52.643452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:52.643452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:12:52.643452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:12:52.643452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:12:52.643452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:52.643452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:12:52.643452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:12:52.643452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '27fb1319-f284-49dc-a3eb-2574997aec2f'} Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:12:52.644375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:12:52.645796 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.647429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-60ab4118-1eac-4271-aa48-914c36151a0c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 404 to user: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:12:52.647429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-60ab4118-1eac-4271-aa48-914c36151a0c tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 404 len: 111 microversion: 2.1 time: 0.030646 Jun 03 13:12:52.647429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 366/722] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:12:52 2022] DELETE /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:12:52.651765 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c3328de3-81ef-4ac2-b8b1-2e0357b6db91 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:52.652380 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c3328de3-81ef-4ac2-b8b1-2e0357b6db91 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: 27fb1319-f284-49dc-a3eb-2574997aec2f] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:52.658816 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c3328de3-81ef-4ac2-b8b1-2e0357b6db91 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:52.659268 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c3328de3-81ef-4ac2-b8b1-2e0357b6db91 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:52.660036 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c3328de3-81ef-4ac2-b8b1-2e0357b6db91 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:52.660470 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c3328de3-81ef-4ac2-b8b1-2e0357b6db91 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:52.674215 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-c3328de3-81ef-4ac2-b8b1-2e0357b6db91 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c3328de3-81ef-4ac2-b8b1-2e0357b6db91 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f HTTP/1.1 Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:12:52.675743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:12:52.677395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:12:52.677395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:52.677395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:52.677395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:52.677395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:52.677395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:12:52.677395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:12:52.677395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:12:52.677395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:52.677395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:12:52.677395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:12:52.677395 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '27fb1319-f284-49dc-a3eb-2574997aec2f'} Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:12:52.678366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. Jun 03 13:12:52.679897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:52.681210 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c3328de3-81ef-4ac2-b8b1-2e0357b6db91 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 404 to user: Instance 27fb1319-f284-49dc-a3eb-2574997aec2f could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:12:52.681210 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c3328de3-81ef-4ac2-b8b1-2e0357b6db91 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f" status: 404 len: 111 microversion: 2.1 time: 0.029257 Jun 03 13:12:52.681210 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 357/723] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:52 2022] GET /compute/v2.1/servers/27fb1319-f284-49dc-a3eb-2574997aec2f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:12:53.826145 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-eb0f56db-9971-42b1-94cf-d2ac9758dbd1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:53.826673 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-eb0f56db-9971-42b1-94cf-d2ac9758dbd1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:53.833756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb0f56db-9971-42b1-94cf-d2ac9758dbd1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:53.834240 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb0f56db-9971-42b1-94cf-d2ac9758dbd1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:53.835026 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb0f56db-9971-42b1-94cf-d2ac9758dbd1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:53.835468 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb0f56db-9971-42b1-94cf-d2ac9758dbd1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:53.849651 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-eb0f56db-9971-42b1-94cf-d2ac9758dbd1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-eb0f56db-9971-42b1-94cf-d2ac9758dbd1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c HTTP/1.1 Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:12:53.851231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:12:53.852726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:12:53.852726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:53.852726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:53.852726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:53.852726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:53.852726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:12:53.852726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:12:53.852726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:12:53.852726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:53.852726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:12:53.852726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:12:53.852726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': 'a85c3fde-c3c5-4354-9c7a-2b432bbdf77c'} Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:12:53.853509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:12:53.854744 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:12:53.855927 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-eb0f56db-9971-42b1-94cf-d2ac9758dbd1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 404 to user: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:12:53.855927 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-eb0f56db-9971-42b1-94cf-d2ac9758dbd1 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 404 len: 111 microversion: 2.1 time: 0.030473 Jun 03 13:12:53.855927 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 367/724] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:12:53 2022] DELETE /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:12:53.861279 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1424de83-5e9a-4496-bcfd-800fa3e95869 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:53.861894 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1424de83-5e9a-4496-bcfd-800fa3e95869 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] [instance: a85c3fde-c3c5-4354-9c7a-2b432bbdf77c] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:12:53.869196 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1424de83-5e9a-4496-bcfd-800fa3e95869 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:53.869653 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1424de83-5e9a-4496-bcfd-800fa3e95869 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:53.870462 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1424de83-5e9a-4496-bcfd-800fa3e95869 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:12:53.871082 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1424de83-5e9a-4496-bcfd-800fa3e95869 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:12:53.885279 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-1424de83-5e9a-4496-bcfd-800fa3e95869 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] HTTP exception thrown: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1424de83-5e9a-4496-bcfd-800fa3e95869 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Request method failure captured: Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c HTTP/1.1 Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgZrvphLq_rvQFuBHJyGS2p2cPfsFVjEKKmhEHMmayQ2ttOLW4HJUaZ3eO-E9c7gPpAefdtXCDy3yjGrhp8S2YBjWO4Hx5KItwpriotcb0h8lrGkNIxnhzRTs5cfgiQChhu32hUJcB-Z0i-n_5Ujl9IHz5UvJGDQfMVcaJ12wntxB6E Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:12:53.886874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:12:53.888383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b6cc7be84d074c319f6c2d8628e76f52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b6cc7be84d074c319f6c2d8628e76f52"}]}] Jun 03 13:12:53.888383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:53.888383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: b6cc7be84d074c319f6c2d8628e76f52 Jun 03 13:12:53.888383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1034320480 Jun 03 13:12:53.888383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:53.888383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:12:53.888383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:12:53.888383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: f2217b3c134d453fbdcb14853eed4e3b Jun 03 13:12:53.888383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeNegativeTest-1034320480-project Jun 03 13:12:53.888383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:12:53.888383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:12:53.888383 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': 'a85c3fde-c3c5-4354-9c7a-2b432bbdf77c'} Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:12:53.889292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. Jun 03 13:12:53.890541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:12:53.891728 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1424de83-5e9a-4496-bcfd-800fa3e95869 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] Returning 404 to user: Instance a85c3fde-c3c5-4354-9c7a-2b432bbdf77c could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:12:53.891728 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1424de83-5e9a-4496-bcfd-800fa3e95869 tempest-AttachVolumeNegativeTest-1034320480 tempest-AttachVolumeNegativeTest-1034320480-project] 10.222.0.58 "GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c" status: 404 len: 111 microversion: 2.1 time: 0.030895 Jun 03 13:12:53.891728 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 358/725] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:12:53 2022] GET /compute/v2.1/servers/a85c3fde-c3c5-4354-9c7a-2b432bbdf77c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:12:58.367350 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5af479d2-7c15-4495-9ec4-3846df2f4474 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Action: 'create', calling method: .version_select at 0x7fc5a42d8d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1239623875"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:12:58.675707 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5af479d2-7c15-4495-9ec4-3846df2f4474 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.433535 Jun 03 13:12:58.676342 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 368/726] 10.222.0.58 () {60 vars in 1154 bytes} [Fri Jun 3 13:12:58 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 435 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 13:12:58.687651 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8a5cc0ea-5485-4a0e-b13c-af9fb8aa04a6 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a4b5d160>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:58.736444 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8a5cc0ea-5485-4a0e-b13c-af9fb8aa04a6 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9" status: 200 len: 345 microversion: 2.1 time: 0.053069 Jun 03 13:12:58.737040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 359/727] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:12:58 2022] GET /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:12:59.754253 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7bed5b40-6971-4055-abd3-ec01a5b42eab tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a958fca0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:12:59.816336 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7bed5b40-6971-4055-abd3-ec01a5b42eab tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9" status: 200 len: 346 microversion: 2.1 time: 0.069290 Jun 03 13:12:59.816895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 369/728] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:12:59 2022] GET /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:12:59.833855 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-84232559-e1c5-4f52-8407-6f37ca9ce8a3 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Action: 'create', calling method: .version_select at 0x7fc5a4b9a160>, body: {"snapshot": {"volume_id": "812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1674781532"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:13:00.013804 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-84232559-e1c5-4f52-8407-6f37ca9ce8a3 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.186646 Jun 03 13:13:00.014494 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 360/729] 10.222.0.58 () {60 vars in 1161 bytes} [Fri Jun 3 13:12:59 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:13:00.026211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8ab59fd5-437f-4be0-a5f7-2eee96903119 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a42d8280>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:00.059566 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8ab59fd5-437f-4be0-a5f7-2eee96903119 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad" status: 200 len: 287 microversion: 2.1 time: 0.037090 Jun 03 13:13:00.060230 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 370/730] 10.222.0.58 () {58 vars in 1250 bytes} [Fri Jun 3 13:13:00 2022] GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:13:00.070954 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-076dea68-aa57-480a-80d7-6d1d551b0614 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a4f2b430>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:00.100040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-076dea68-aa57-480a-80d7-6d1d551b0614 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032893 Jun 03 13:13:00.100600 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 361/731] 10.222.0.58 () {58 vars in 1139 bytes} [Fri Jun 3 13:13:00 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:13:00.110810 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-41306df5-76bb-46c5-a815-e034866528b7 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a42d89d0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:00.140909 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-41306df5-76bb-46c5-a815-e034866528b7 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad" status: 200 len: 287 microversion: 2.1 time: 0.033813 Jun 03 13:13:00.141418 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 371/732] 10.222.0.58 () {58 vars in 1250 bytes} [Fri Jun 3 13:13:00 2022] GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:13:01.153408 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1e5dd4d0-05a1-4645-9c93-7efd7834759a tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a4b5da60>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:01.183391 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1e5dd4d0-05a1-4645-9c93-7efd7834759a tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad" status: 200 len: 287 microversion: 2.1 time: 0.034368 Jun 03 13:13:01.183957 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 362/733] 10.222.0.58 () {58 vars in 1250 bytes} [Fri Jun 3 13:13:01 2022] GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:13:02.200436 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6ac90b42-7e81-442f-8ee0-7b8c92c7b31d tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a42bf430>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:02.239331 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6ac90b42-7e81-442f-8ee0-7b8c92c7b31d tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad" status: 200 len: 287 microversion: 2.1 time: 0.045574 Jun 03 13:13:02.240081 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 372/734] 10.222.0.58 () {58 vars in 1250 bytes} [Fri Jun 3 13:13:02 2022] GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:13:03.256989 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-48342ace-af51-46fa-88bb-2f42827666f7 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a41a60d0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:03.296748 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-48342ace-af51-46fa-88bb-2f42827666f7 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad" status: 200 len: 287 microversion: 2.1 time: 0.047586 Jun 03 13:13:03.297455 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 363/735] 10.222.0.58 () {58 vars in 1250 bytes} [Fri Jun 3 13:13:03 2022] GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:13:04.308937 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:04.310174 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:04.315696 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b90fc272-dd1b-48df-9ced-4a263464b16d tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a42bfca0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:04.347060 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b90fc272-dd1b-48df-9ced-4a263464b16d tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad" status: 200 len: 287 microversion: 2.1 time: 0.040439 Jun 03 13:13:04.347649 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 373/736] 10.222.0.58 () {58 vars in 1250 bytes} [Fri Jun 3 13:13:04 2022] GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:13:05.357207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:05.357965 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=30 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:13:05.363292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3f7615e9-2f9d-4e92-8f51-dd12a90d2324 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a4b5d3a0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:05.399390 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3f7615e9-2f9d-4e92-8f51-dd12a90d2324 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad" status: 200 len: 288 microversion: 2.1 time: 0.042887 Jun 03 13:13:05.399963 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 364/737] 10.222.0.58 () {58 vars in 1250 bytes} [Fri Jun 3 13:13:05 2022] GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad => generated 288 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:13:05.411542 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-022f3c9e-9fbe-4468-abbc-53dfde6b7fed tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a42d80d0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:05.479741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-022f3c9e-9fbe-4468-abbc-53dfde6b7fed tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad" status: 202 len: 0 microversion: 2.1 time: 0.072289 Jun 03 13:13:05.480773 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 374/738] 10.222.0.58 () {58 vars in 1253 bytes} [Fri Jun 3 13:13:05 2022] DELETE /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:13:05.491397 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-64283066-ba7d-4d88-9b37-e00e8505c566 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a4b9aee0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:05.528693 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-64283066-ba7d-4d88-9b37-e00e8505c566 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad" status: 200 len: 287 microversion: 2.1 time: 0.041283 Jun 03 13:13:05.529349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 365/739] 10.222.0.58 () {58 vars in 1250 bytes} [Fri Jun 3 13:13:05 2022] GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:13:06.543052 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2b17b9de-1f8a-4600-87ed-a4deabc6ba88 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a958f310>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:06.570023 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-2b17b9de-1f8a-4600-87ed-a4deabc6ba88 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] HTTP exception thrown: Snapshot ce6bd083-bb9d-489f-92aa-1a012f730aad could not be found. Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2b17b9de-1f8a-4600-87ed-a4deabc6ba88 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Request method failure captured: Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad HTTP/1.1 Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgjaUe2AKzuplbzi4GYvnXp_sLemZZ-LJ8dace04Pv_s_zfjTXkIjxwIpfT6SHEUbAVDLYueyRZ48Hc-u9NYynAU8Z8WdhuyhxTCswNKZLg40uXn_EcKA4XAxy8Xr0P3sqfpq59y0t9z1mFHECH3b-ydr8a2Kw2wZzw0Ns0xZS0PKH4 Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 93e3f789241c4802b575734da6682f90 Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1863628690 Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:13:06.572264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93e3f789241c4802b575734da6682f90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_93e3f789241c4802b575734da6682f90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/93e3f789241c4802b575734da6682f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93e3f789241c4802b575734da6682f90"}]}] Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1863628690 Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 93e3f789241c4802b575734da6682f90 Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1863628690 Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesSnapshotsTestJSON-1863628690-project Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: ef0cc2f090b240679d5d479d8890f0eb Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1863628690-project Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Snapshot ce6bd083-bb9d-489f-92aa-1a012f730aad could not be found. Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': 'ce6bd083-bb9d-489f-92aa-1a012f730aad'} Jun 03 13:13:06.573832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ce6bd083-bb9d-489f-92aa-1a012f730aad could not be found. (HTTP 404) (Request-ID: req-d41b4efe-7afc-4138-9bfd-0ca452c1c5a7) Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:06.574757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:13:06.575942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ce6bd083-bb9d-489f-92aa-1a012f730aad could not be found. Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 03 13:13:06.577079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ce6bd083-bb9d-489f-92aa-1a012f730aad could not be found. Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ce6bd083-bb9d-489f-92aa-1a012f730aad could not be found. Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2b17b9de-1f8a-4600-87ed-a4deabc6ba88 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Returning 404 to user: Snapshot ce6bd083-bb9d-489f-92aa-1a012f730aad could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:13:06.578319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2b17b9de-1f8a-4600-87ed-a4deabc6ba88 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad" status: 404 len: 111 microversion: 2.1 time: 0.035182 Jun 03 13:13:06.579380 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 375/740] 10.222.0.58 () {58 vars in 1250 bytes} [Fri Jun 3 13:13:06 2022] GET /compute/v2.1/os-snapshots/ce6bd083-bb9d-489f-92aa-1a012f730aad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:13:06.583037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-40dbd471-8d22-436e-bcf2-b89f49e5e374 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a4b41820>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:06.650816 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-40dbd471-8d22-436e-bcf2-b89f49e5e374 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9" status: 202 len: 0 microversion: 2.1 time: 0.071720 Jun 03 13:13:06.651640 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 366/741] 10.222.0.58 () {58 vars in 1247 bytes} [Fri Jun 3 13:13:06 2022] DELETE /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:13:06.661407 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-380feef0-1428-41dd-a6cf-55d9312e3425 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a4312550>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:06.709476 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-380feef0-1428-41dd-a6cf-55d9312e3425 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9" status: 200 len: 345 microversion: 2.1 time: 0.052145 Jun 03 13:13:06.710060 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 376/742] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:13:06 2022] GET /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:13:07.727386 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-899d719c-d483-49eb-a3d3-0e17337fc776 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a4b5d280>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:07.758812 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-899d719c-d483-49eb-a3d3-0e17337fc776 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] HTTP exception thrown: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-899d719c-d483-49eb-a3d3-0e17337fc776 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Request method failure captured: Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 HTTP/1.1 Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgjaUe2AKzuplbzi4GYvnXp_sLemZZ-LJ8dace04Pv_s_zfjTXkIjxwIpfT6SHEUbAVDLYueyRZ48Hc-u9NYynAU8Z8WdhuyhxTCswNKZLg40uXn_EcKA4XAxy8Xr0P3sqfpq59y0t9z1mFHECH3b-ydr8a2Kw2wZzw0Ns0xZS0PKH4 Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 93e3f789241c4802b575734da6682f90 Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1863628690 Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:13:07.761932 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93e3f789241c4802b575734da6682f90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_93e3f789241c4802b575734da6682f90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/93e3f789241c4802b575734da6682f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93e3f789241c4802b575734da6682f90"}]}] Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1863628690 Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 93e3f789241c4802b575734da6682f90 Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1863628690 Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesSnapshotsTestJSON-1863628690-project Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: ef0cc2f090b240679d5d479d8890f0eb Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1863628690-project Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9'} Jun 03 13:13:07.763570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. (HTTP 404) (Request-ID: req-d4454c0e-a656-40b4-be18-9f7c59993edb) Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:13:07.764508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:13:07.765936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 13:13:07.767622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-899d719c-d483-49eb-a3d3-0e17337fc776 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Returning 404 to user: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-899d719c-d483-49eb-a3d3-0e17337fc776 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9" status: 404 len: 109 microversion: 2.1 time: 0.043414 Jun 03 13:13:07.769014 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 367/743] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:13:07 2022] GET /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:13:07.777991 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a31a2b14-bc42-49ba-bc6e-e78bd964b483 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a42b2ca0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:07.806085 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-a31a2b14-bc42-49ba-bc6e-e78bd964b483 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] HTTP exception thrown: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a31a2b14-bc42-49ba-bc6e-e78bd964b483 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Request method failure captured: Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 HTTP/1.1 Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgjaUe2AKzuplbzi4GYvnXp_sLemZZ-LJ8dace04Pv_s_zfjTXkIjxwIpfT6SHEUbAVDLYueyRZ48Hc-u9NYynAU8Z8WdhuyhxTCswNKZLg40uXn_EcKA4XAxy8Xr0P3sqfpq59y0t9z1mFHECH3b-ydr8a2Kw2wZzw0Ns0xZS0PKH4 Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 93e3f789241c4802b575734da6682f90 Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1863628690 Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:13:07.808050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93e3f789241c4802b575734da6682f90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_93e3f789241c4802b575734da6682f90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/93e3f789241c4802b575734da6682f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93e3f789241c4802b575734da6682f90"}]}] Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1863628690 Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 93e3f789241c4802b575734da6682f90 Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1863628690 Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesSnapshotsTestJSON-1863628690-project Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: ef0cc2f090b240679d5d479d8890f0eb Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1863628690-project Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9'} Jun 03 13:13:07.809422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. (HTTP 404) (Request-ID: req-9aaf2bdb-c2dc-4eee-b5d4-849df8cc7884) Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:13:07.810399 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 13:13:07.811633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 13:13:07.812737 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a31a2b14-bc42-49ba-bc6e-e78bd964b483 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Returning 404 to user: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a31a2b14-bc42-49ba-bc6e-e78bd964b483 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9" status: 404 len: 109 microversion: 2.1 time: 0.035934 Jun 03 13:13:07.813844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 377/744] 10.222.0.58 () {58 vars in 1247 bytes} [Fri Jun 3 13:13:07 2022] DELETE /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:13:07.818037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2a8d32e3-c6af-4012-bf45-e58f9a6532f6 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Calling method '.version_select at 0x7fc5a4cd6550>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:13:07.846271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-2a8d32e3-c6af-4012-bf45-e58f9a6532f6 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] HTTP exception thrown: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2a8d32e3-c6af-4012-bf45-e58f9a6532f6 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Request method failure captured: Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 HTTP/1.1 Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgjaUe2AKzuplbzi4GYvnXp_sLemZZ-LJ8dace04Pv_s_zfjTXkIjxwIpfT6SHEUbAVDLYueyRZ48Hc-u9NYynAU8Z8WdhuyhxTCswNKZLg40uXn_EcKA4XAxy8Xr0P3sqfpq59y0t9z1mFHECH3b-ydr8a2Kw2wZzw0Ns0xZS0PKH4 Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 93e3f789241c4802b575734da6682f90 Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1863628690 Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:13:07.848222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93e3f789241c4802b575734da6682f90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_93e3f789241c4802b575734da6682f90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/93e3f789241c4802b575734da6682f90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93e3f789241c4802b575734da6682f90"}]}] Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1863628690 Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 93e3f789241c4802b575734da6682f90 Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1863628690 Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesSnapshotsTestJSON-1863628690-project Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: ef0cc2f090b240679d5d479d8890f0eb Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1863628690-project Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9'} Jun 03 13:13:07.849740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. (HTTP 404) (Request-ID: req-644143c7-a2b0-4ab9-b5e1-05949628c804) Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:13:07.850723 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:13:07.852099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 13:13:07.853710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2a8d32e3-c6af-4012-bf45-e58f9a6532f6 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] Returning 404 to user: Volume 812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2a8d32e3-c6af-4012-bf45-e58f9a6532f6 tempest-VolumesSnapshotsTestJSON-1863628690 tempest-VolumesSnapshotsTestJSON-1863628690-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9" status: 404 len: 109 microversion: 2.1 time: 0.035464 Jun 03 13:13:07.855159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 368/745] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:13:07 2022] GET /compute/v2.1/os-volumes/812cfafa-2f24-4d00-ac5c-2cbc8c6cfdb9 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:14:03.626992 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:14:03.627664 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Fri Jun 3 13:14:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:14:03.693428 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fc49a068-542b-4e5c-889d-2623988f043a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:03.694055 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fc49a068-542b-4e5c-889d-2623988f043a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:03.700063 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc49a068-542b-4e5c-889d-2623988f043a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:03.700475 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc49a068-542b-4e5c-889d-2623988f043a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:03.701212 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc49a068-542b-4e5c-889d-2623988f043a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:03.701642 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc49a068-542b-4e5c-889d-2623988f043a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:03.730340 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fc49a068-542b-4e5c-889d-2623988f043a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/os-volume_attachments/ced6b800-6c8c-466b-8e33-6426721dbedb" status: 200 len: 194 microversion: 2.20 time: 0.042751 Jun 03 13:14:03.730939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 378/746] 10.222.0.58 () {60 vars in 1453 bytes} [Fri Jun 3 13:14:03 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/os-volume_attachments/ced6b800-6c8c-466b-8e33-6426721dbedb => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:14:03.796779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1a4bd6de-c02c-4924-8556-c664d1d7b068 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:03.797197 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1a4bd6de-c02c-4924-8556-c664d1d7b068 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:03.805318 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a4bd6de-c02c-4924-8556-c664d1d7b068 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:03.805761 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a4bd6de-c02c-4924-8556-c664d1d7b068 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:03.806630 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a4bd6de-c02c-4924-8556-c664d1d7b068 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:03.807143 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1a4bd6de-c02c-4924-8556-c664d1d7b068 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:03.909026 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-1a4bd6de-c02c-4924-8556-c664d1d7b068 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lazy-loading 'services' on Instance uuid 0321187a-23dc-4d94-a1d1-e341d8fdf035 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:14:03.993637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1a4bd6de-c02c-4924-8556-c664d1d7b068 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/os-volume_attachments/ced6b800-6c8c-466b-8e33-6426721dbedb" status: 202 len: 0 microversion: 2.20 time: 0.202126 Jun 03 13:14:03.994403 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 369/747] 10.222.0.58 () {60 vars in 1456 bytes} [Fri Jun 3 13:14:03 2022] DELETE /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/os-volume_attachments/ced6b800-6c8c-466b-8e33-6426721dbedb => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:14:04.002983 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4206c656-ad2e-4575-8c9f-5a50c3489c87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:04.004004 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4206c656-ad2e-4575-8c9f-5a50c3489c87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:04.010365 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4206c656-ad2e-4575-8c9f-5a50c3489c87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:04.011122 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4206c656-ad2e-4575-8c9f-5a50c3489c87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:04.012159 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4206c656-ad2e-4575-8c9f-5a50c3489c87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:04.012819 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4206c656-ad2e-4575-8c9f-5a50c3489c87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:04.044897 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4206c656-ad2e-4575-8c9f-5a50c3489c87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045958 Jun 03 13:14:04.045465 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 379/748] 10.222.0.58 () {60 vars in 1342 bytes} [Fri Jun 3 13:14:03 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 13:14:05.063398 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0cc1c19a-ce51-416d-bfb7-cde9ce69e7a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:05.065125 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0cc1c19a-ce51-416d-bfb7-cde9ce69e7a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:05.075941 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0cc1c19a-ce51-416d-bfb7-cde9ce69e7a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:05.076694 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0cc1c19a-ce51-416d-bfb7-cde9ce69e7a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:05.077977 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0cc1c19a-ce51-416d-bfb7-cde9ce69e7a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:05.078746 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0cc1c19a-ce51-416d-bfb7-cde9ce69e7a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:05.111317 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0cc1c19a-ce51-416d-bfb7-cde9ce69e7a6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056036 Jun 03 13:14:05.111890 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 370/749] 10.222.0.58 () {60 vars in 1342 bytes} [Fri Jun 3 13:14:05 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:05.181216 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1d4406c0-b417-423f-8659-2580ddaaacd4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:05.181771 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1d4406c0-b417-423f-8659-2580ddaaacd4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:05.188834 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d4406c0-b417-423f-8659-2580ddaaacd4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:05.189283 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d4406c0-b417-423f-8659-2580ddaaacd4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:05.190056 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d4406c0-b417-423f-8659-2580ddaaacd4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:05.190517 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1d4406c0-b417-423f-8659-2580ddaaacd4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:05.221658 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1d4406c0-b417-423f-8659-2580ddaaacd4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:14:05.323293 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1d4406c0-b417-423f-8659-2580ddaaacd4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 204 len: 0 microversion: 2.20 time: 0.143366 Jun 03 13:14:05.324284 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 380/750] 10.222.0.58 () {60 vars in 1279 bytes} [Fri Jun 3 13:14:05 2022] DELETE /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 13:14:05.333424 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3040e03f-2908-4582-ba7e-60a182f358f6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:05.334036 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3040e03f-2908-4582-ba7e-60a182f358f6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:05.342859 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3040e03f-2908-4582-ba7e-60a182f358f6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:05.343532 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3040e03f-2908-4582-ba7e-60a182f358f6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:05.344483 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3040e03f-2908-4582-ba7e-60a182f358f6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:05.344911 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3040e03f-2908-4582-ba7e-60a182f358f6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:05.497523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3040e03f-2908-4582-ba7e-60a182f358f6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:05.507057 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3040e03f-2908-4582-ba7e-60a182f358f6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:05.508587 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3040e03f-2908-4582-ba7e-60a182f358f6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:05.509778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3040e03f-2908-4582-ba7e-60a182f358f6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.180629 Jun 03 13:14:05.510592 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 371/751] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:05 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:06.529752 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d2ebf898-a1f2-44a2-848e-cbf1f274d2c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:06.535604 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d2ebf898-a1f2-44a2-848e-cbf1f274d2c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:06.547342 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d2ebf898-a1f2-44a2-848e-cbf1f274d2c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:06.547783 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d2ebf898-a1f2-44a2-848e-cbf1f274d2c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:06.548574 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d2ebf898-a1f2-44a2-848e-cbf1f274d2c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:06.549006 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d2ebf898-a1f2-44a2-848e-cbf1f274d2c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:06.692276 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d2ebf898-a1f2-44a2-848e-cbf1f274d2c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:06.700701 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d2ebf898-a1f2-44a2-848e-cbf1f274d2c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:06.702236 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d2ebf898-a1f2-44a2-848e-cbf1f274d2c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:06.703422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d2ebf898-a1f2-44a2-848e-cbf1f274d2c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1723 microversion: 2.20 time: 0.177932 Jun 03 13:14:06.704019 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 381/752] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:06 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:07.722488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1268c9c4-1753-4c44-95d4-94f758bc5945 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:07.723346 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1268c9c4-1753-4c44-95d4-94f758bc5945 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:07.731080 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1268c9c4-1753-4c44-95d4-94f758bc5945 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:07.731683 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1268c9c4-1753-4c44-95d4-94f758bc5945 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:07.732797 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1268c9c4-1753-4c44-95d4-94f758bc5945 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:07.733253 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1268c9c4-1753-4c44-95d4-94f758bc5945 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:07.801461 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1268c9c4-1753-4c44-95d4-94f758bc5945 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:07.811231 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1268c9c4-1753-4c44-95d4-94f758bc5945 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:07.812950 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1268c9c4-1753-4c44-95d4-94f758bc5945 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:07.814346 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1268c9c4-1753-4c44-95d4-94f758bc5945 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 200 len: 1655 microversion: 2.20 time: 0.096080 Jun 03 13:14:07.815443 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 372/753] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:07 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 1655 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:08.115674 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-941f2017-1a69-4b29-95ca-81846b5e9e36 req-f9774419-3b64-4681-9fe7-f94b82be5d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0321187a-23dc-4d94-a1d1-e341d8fdf035", "name": "network-vif-deleted", "tag": "1fae557f-ecd4-4f44-ad00-3f1f17914ef1"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:08.126920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-941f2017-1a69-4b29-95ca-81846b5e9e36 req-f9774419-3b64-4681-9fe7-f94b82be5d16 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:08.127505 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-941f2017-1a69-4b29-95ca-81846b5e9e36 req-f9774419-3b64-4681-9fe7-f94b82be5d16 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:08.141951 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-941f2017-1a69-4b29-95ca-81846b5e9e36 req-f9774419-3b64-4681-9fe7-f94b82be5d16 service nova] Creating event network-vif-deleted:1fae557f-ecd4-4f44-ad00-3f1f17914ef1 for instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 on hv-cinder-77954 Jun 03 13:14:08.147473 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-941f2017-1a69-4b29-95ca-81846b5e9e36 req-f9774419-3b64-4681-9fe7-f94b82be5d16 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285616 Jun 03 13:14:08.148134 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 382/754] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:08.832666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-45601b19-77d8-4c45-8324-0d91e27379d9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:08.833694 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-45601b19-77d8-4c45-8324-0d91e27379d9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:08.841348 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45601b19-77d8-4c45-8324-0d91e27379d9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:08.841798 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45601b19-77d8-4c45-8324-0d91e27379d9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:08.842686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45601b19-77d8-4c45-8324-0d91e27379d9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:08.843117 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-45601b19-77d8-4c45-8324-0d91e27379d9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:08.857566 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-45601b19-77d8-4c45-8324-0d91e27379d9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] HTTP exception thrown: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-45601b19-77d8-4c45-8324-0d91e27379d9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Request method failure captured: Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 HTTP/1.1 Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimggsCu1QqC4sdBq_S3SgbeYiDpuNEHjM4Y87AKRUvxbU1aziVyBQldQOcYxH0V14gqDyyCm56eWgfn0N0mQx5EI9Rmc1M0Pk79Ij3qSH5ZhZ7uH7w37JulL1vhPJWdq2uKDhjMmDzBGdWFszMCxST2aUlnMdQpfs0u8vHW0W4X6moII Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 020ed9813c614d2eae9568ba85728136 Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:14:08.859349 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:14:08.860779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/020ed9813c614d2eae9568ba85728136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_020ed9813c614d2eae9568ba85728136"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/020ed9813c614d2eae9568ba85728136"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/020ed9813c614d2eae9568ba85728136"}]}] Jun 03 13:14:08.860779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:14:08.860779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 020ed9813c614d2eae9568ba85728136 Jun 03 13:14:08.860779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:14:08.860779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeShelveTestJSON-1022356808-project Jun 03 13:14:08.860779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:14:08.860779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:14:08.860779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 49b596abb9a5466595eec1a8fb25d5a1 Jun 03 13:14:08.860779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1022356808-project Jun 03 13:14:08.860779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:14:08.860779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:14:08.860779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '0321187a-23dc-4d94-a1d1-e341d8fdf035'} Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:14:08.861695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:14:08.863523 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:14:08.864708 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-45601b19-77d8-4c45-8324-0d91e27379d9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Returning 404 to user: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:14:08.864708 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-45601b19-77d8-4c45-8324-0d91e27379d9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 404 len: 111 microversion: 2.20 time: 0.032864 Jun 03 13:14:08.864708 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 373/755] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:08 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:14:08.872621 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-377da5b5-b344-436e-a740-9fbac57c4447 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '.version_select at 0x7fc5a431eb80>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:08.877500 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR oslo.messaging._drivers.impl_rabbit [None req-377da5b5-b344-436e-a740-9fbac57c4447 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [72fdfa76-4aaa-4b44-aa1e-a7d82db2abf7] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 03 13:14:09.885262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [None req-377da5b5-b344-436e-a740-9fbac57c4447 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [72fdfa76-4aaa-4b44-aa1e-a7d82db2abf7] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60662. Jun 03 13:14:09.907689 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-377da5b5-b344-436e-a740-9fbac57c4447 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-147115609" status: 204 len: 0 microversion: 2.20 time: 1.040512 Jun 03 13:14:09.908221 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 383/756] 10.222.0.58 () {60 vars in 1258 bytes} [Fri Jun 3 13:14:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-147115609 => generated 0 bytes in 1042 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 13:14:10.569454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-37397bd5-6802-44ee-a933-08d2506e3509 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Action: 'create', calling method: .version_select at 0x7fc5a4b9a3a0>, body: {"keypair": {"name": "tempest-keypair-955934959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCj9CYXTBsoY01lDRUNdqGlJRgdcXhZJp3O2/ct+Vbi4ddKLz2P94/HN+iHscw2tZFq/NCLREjs88SpB9nTC8b1abXXjKUJJTlyHNDt473LZiznTUdYAtWuzE+5VLUsZ4A=="}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:10.583795 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-37397bd5-6802-44ee-a933-08d2506e3509 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Getting quotas for project 020ed9813c614d2eae9568ba85728136. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:14:10.587834 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-37397bd5-6802-44ee-a933-08d2506e3509 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Getting quotas for user 49b596abb9a5466595eec1a8fb25d5a1 and project 020ed9813c614d2eae9568ba85728136. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:14:10.612670 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-37397bd5-6802-44ee-a933-08d2506e3509 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047237 Jun 03 13:14:10.614008 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 374/757] 10.222.0.58 () {62 vars in 1199 bytes} [Fri Jun 3 13:14:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 13:14:11.967680 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-836412584", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "56b39612-cd1c-430f-8391-8e3320755ed0"}], "security_groups": [{"name": "tempest-securitygroup--1283735660"}], "key_name": "tempest-keypair-955934959", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:12.077663 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] validate_networks() for [('56b39612-cd1c-430f-8391-8e3320755ed0', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:14:12.468839 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:14:12.469581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:14:12.470400 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:14:12.470820 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:14:12.471238 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:14:12.483000 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:12.483531 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:12.484394 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:12.485055 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:12.503984 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Getting quotas for project 020ed9813c614d2eae9568ba85728136. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:14:12.507936 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Getting quotas for user 49b596abb9a5466595eec1a8fb25d5a1 and project 020ed9813c614d2eae9568ba85728136. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:14:12.519115 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:14:12.521485 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:14:12.569065 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-91c92941-6575-4a3e-96e5-694b962d34fc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.606202 Jun 03 13:14:12.569728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 384/758] 10.222.0.58 () {62 vars in 1187 bytes} [Fri Jun 3 13:14:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 13:14:12.580886 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-942b5d61-34c8-490f-b1e7-db10968ac4b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:12.581951 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-942b5d61-34c8-490f-b1e7-db10968ac4b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:12.656797 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-942b5d61-34c8-490f-b1e7-db10968ac4b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:12.665146 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-942b5d61-34c8-490f-b1e7-db10968ac4b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:12.666985 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-942b5d61-34c8-490f-b1e7-db10968ac4b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:12.668311 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-942b5d61-34c8-490f-b1e7-db10968ac4b8 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1280 microversion: 2.20 time: 0.092438 Jun 03 13:14:12.669214 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 375/759] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:12 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:13.691369 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-48c58900-6efb-403d-8663-8ced7097bd89 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:13.692144 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-48c58900-6efb-403d-8663-8ced7097bd89 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:13.699148 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48c58900-6efb-403d-8663-8ced7097bd89 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:13.699608 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48c58900-6efb-403d-8663-8ced7097bd89 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:13.700395 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48c58900-6efb-403d-8663-8ced7097bd89 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:13.700836 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-48c58900-6efb-403d-8663-8ced7097bd89 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:13.778539 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-48c58900-6efb-403d-8663-8ced7097bd89 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:13.786935 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-48c58900-6efb-403d-8663-8ced7097bd89 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:13.788678 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-48c58900-6efb-403d-8663-8ced7097bd89 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:13.790035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-48c58900-6efb-403d-8663-8ced7097bd89 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1338 microversion: 2.20 time: 0.102933 Jun 03 13:14:13.791117 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 385/760] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:13 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1338 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:14.808718 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-26decc67-ec25-4fa0-aa67-67854882a21d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:14.809348 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-26decc67-ec25-4fa0-aa67-67854882a21d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:14.822407 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26decc67-ec25-4fa0-aa67-67854882a21d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:14.822545 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26decc67-ec25-4fa0-aa67-67854882a21d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:14.823267 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26decc67-ec25-4fa0-aa67-67854882a21d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:14.824205 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-26decc67-ec25-4fa0-aa67-67854882a21d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:15.001385 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-26decc67-ec25-4fa0-aa67-67854882a21d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:15.013683 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-26decc67-ec25-4fa0-aa67-67854882a21d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:15.015236 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-26decc67-ec25-4fa0-aa67-67854882a21d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:15.016571 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-26decc67-ec25-4fa0-aa67-67854882a21d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1406 microversion: 2.20 time: 0.212037 Jun 03 13:14:15.017612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 376/761] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:14 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:15.094300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-46192cd4-c591-4ad2-ae29-7a534689aba0 req-5567b471-9a3e-4dc3-84c4-41d13ceaebef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d2637b-e308-49ad-a633-946086696188", "tag": "b413ac88-a552-4af1-9a97-aa251a314588"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:15.130158 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-46192cd4-c591-4ad2-ae29-7a534689aba0 req-5567b471-9a3e-4dc3-84c4-41d13ceaebef service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:15.131122 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-46192cd4-c591-4ad2-ae29-7a534689aba0 req-5567b471-9a3e-4dc3-84c4-41d13ceaebef service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:15.143988 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-46192cd4-c591-4ad2-ae29-7a534689aba0 req-5567b471-9a3e-4dc3-84c4-41d13ceaebef service nova] Creating event network-changed:b413ac88-a552-4af1-9a97-aa251a314588 for instance b7d2637b-e308-49ad-a633-946086696188 on hv-cinder-77954 Jun 03 13:14:15.157449 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-46192cd4-c591-4ad2-ae29-7a534689aba0 req-5567b471-9a3e-4dc3-84c4-41d13ceaebef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067327 Jun 03 13:14:15.158236 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 386/762] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:16.035200 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b10397ee-3d1a-4e18-95df-e8cd70c82577 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:16.035816 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b10397ee-3d1a-4e18-95df-e8cd70c82577 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:16.042640 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b10397ee-3d1a-4e18-95df-e8cd70c82577 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:16.043082 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b10397ee-3d1a-4e18-95df-e8cd70c82577 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:16.043940 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b10397ee-3d1a-4e18-95df-e8cd70c82577 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:16.044285 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b10397ee-3d1a-4e18-95df-e8cd70c82577 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:16.181231 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b10397ee-3d1a-4e18-95df-e8cd70c82577 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:16.189208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b10397ee-3d1a-4e18-95df-e8cd70c82577 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:16.190752 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b10397ee-3d1a-4e18-95df-e8cd70c82577 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:16.193428 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b10397ee-3d1a-4e18-95df-e8cd70c82577 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1406 microversion: 2.20 time: 0.161211 Jun 03 13:14:16.193428 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 377/763] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:16 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:17.211396 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7e68f7fb-6bb5-47b2-8c76-22984fb5fbe1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:17.212102 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7e68f7fb-6bb5-47b2-8c76-22984fb5fbe1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:17.218364 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e68f7fb-6bb5-47b2-8c76-22984fb5fbe1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:17.218781 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e68f7fb-6bb5-47b2-8c76-22984fb5fbe1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:17.219558 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e68f7fb-6bb5-47b2-8c76-22984fb5fbe1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:17.219995 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7e68f7fb-6bb5-47b2-8c76-22984fb5fbe1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:17.359733 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7e68f7fb-6bb5-47b2-8c76-22984fb5fbe1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:17.369130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7e68f7fb-6bb5-47b2-8c76-22984fb5fbe1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:17.370669 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7e68f7fb-6bb5-47b2-8c76-22984fb5fbe1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:17.371786 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7e68f7fb-6bb5-47b2-8c76-22984fb5fbe1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1406 microversion: 2.20 time: 0.165387 Jun 03 13:14:17.372459 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 387/764] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:17 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:18.394617 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6c6a175f-d486-4bdb-8c97-c76f61fa9f1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:18.395698 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6c6a175f-d486-4bdb-8c97-c76f61fa9f1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:18.404565 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c6a175f-d486-4bdb-8c97-c76f61fa9f1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:18.405262 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c6a175f-d486-4bdb-8c97-c76f61fa9f1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:18.406547 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c6a175f-d486-4bdb-8c97-c76f61fa9f1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:18.407260 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c6a175f-d486-4bdb-8c97-c76f61fa9f1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:18.550244 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c6a175f-d486-4bdb-8c97-c76f61fa9f1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:18.558597 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c6a175f-d486-4bdb-8c97-c76f61fa9f1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:18.560105 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c6a175f-d486-4bdb-8c97-c76f61fa9f1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:18.561234 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6c6a175f-d486-4bdb-8c97-c76f61fa9f1c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1406 microversion: 2.20 time: 0.173414 Jun 03 13:14:18.561799 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 378/765] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:18 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:19.579116 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cff7ddaa-903f-4d8f-93e8-11ed49348360 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:19.579703 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cff7ddaa-903f-4d8f-93e8-11ed49348360 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:19.586293 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cff7ddaa-903f-4d8f-93e8-11ed49348360 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:19.586741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cff7ddaa-903f-4d8f-93e8-11ed49348360 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:19.587523 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cff7ddaa-903f-4d8f-93e8-11ed49348360 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:19.587992 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cff7ddaa-903f-4d8f-93e8-11ed49348360 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:19.725254 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cff7ddaa-903f-4d8f-93e8-11ed49348360 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:19.734105 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cff7ddaa-903f-4d8f-93e8-11ed49348360 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:19.735702 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cff7ddaa-903f-4d8f-93e8-11ed49348360 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:19.736955 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cff7ddaa-903f-4d8f-93e8-11ed49348360 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1406 microversion: 2.20 time: 0.161693 Jun 03 13:14:19.737648 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 388/766] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:19 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:20.755772 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f3600e31-c3e5-40a6-8c5d-e07d5cfe2bdc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:20.756370 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f3600e31-c3e5-40a6-8c5d-e07d5cfe2bdc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:20.762769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f3600e31-c3e5-40a6-8c5d-e07d5cfe2bdc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:20.763196 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f3600e31-c3e5-40a6-8c5d-e07d5cfe2bdc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:20.764217 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f3600e31-c3e5-40a6-8c5d-e07d5cfe2bdc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:20.764610 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f3600e31-c3e5-40a6-8c5d-e07d5cfe2bdc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:20.808878 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-53c25828-1431-4fca-8084-20f89269c7c7 req-a6fc2b6a-386c-4228-8709-3800141e1dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d2637b-e308-49ad-a633-946086696188", "name": "network-vif-plugged", "status": "completed", "tag": "b413ac88-a552-4af1-9a97-aa251a314588"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:20.818394 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-53c25828-1431-4fca-8084-20f89269c7c7 req-a6fc2b6a-386c-4228-8709-3800141e1dcf service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:20.818841 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-53c25828-1431-4fca-8084-20f89269c7c7 req-a6fc2b6a-386c-4228-8709-3800141e1dcf service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:20.830614 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-53c25828-1431-4fca-8084-20f89269c7c7 req-a6fc2b6a-386c-4228-8709-3800141e1dcf service nova] Creating event network-vif-plugged:b413ac88-a552-4af1-9a97-aa251a314588 for instance b7d2637b-e308-49ad-a633-946086696188 on hv-cinder-77954 Jun 03 13:14:20.835845 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-53c25828-1431-4fca-8084-20f89269c7c7 req-a6fc2b6a-386c-4228-8709-3800141e1dcf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030688 Jun 03 13:14:20.836646 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 389/767] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:20.912716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f3600e31-c3e5-40a6-8c5d-e07d5cfe2bdc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:20.921444 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f3600e31-c3e5-40a6-8c5d-e07d5cfe2bdc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:20.923107 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f3600e31-c3e5-40a6-8c5d-e07d5cfe2bdc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:20.924228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f3600e31-c3e5-40a6-8c5d-e07d5cfe2bdc tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1406 microversion: 2.20 time: 0.172693 Jun 03 13:14:20.924779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 379/768] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:20 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:21.946380 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-396dc919-39d9-45b5-808e-0c3415653272 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:21.947111 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-396dc919-39d9-45b5-808e-0c3415653272 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:21.953669 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-396dc919-39d9-45b5-808e-0c3415653272 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:21.954132 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-396dc919-39d9-45b5-808e-0c3415653272 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:21.954927 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-396dc919-39d9-45b5-808e-0c3415653272 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:21.955366 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-396dc919-39d9-45b5-808e-0c3415653272 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:22.097122 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-396dc919-39d9-45b5-808e-0c3415653272 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:22.105411 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-396dc919-39d9-45b5-808e-0c3415653272 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:22.106990 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-396dc919-39d9-45b5-808e-0c3415653272 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:22.108108 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-396dc919-39d9-45b5-808e-0c3415653272 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1406 microversion: 2.20 time: 0.168295 Jun 03 13:14:22.108674 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 390/769] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:21 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:23.128022 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-85097869-5e10-4289-b3ac-68f21450f5c1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:23.128581 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-85097869-5e10-4289-b3ac-68f21450f5c1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:23.131866 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:23.138376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85097869-5e10-4289-b3ac-68f21450f5c1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:23.138875 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85097869-5e10-4289-b3ac-68f21450f5c1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:23.139714 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85097869-5e10-4289-b3ac-68f21450f5c1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:23.140195 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-85097869-5e10-4289-b3ac-68f21450f5c1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:23.285997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-85097869-5e10-4289-b3ac-68f21450f5c1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:23.294914 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-85097869-5e10-4289-b3ac-68f21450f5c1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:23.296401 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-85097869-5e10-4289-b3ac-68f21450f5c1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:23.297499 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-85097869-5e10-4289-b3ac-68f21450f5c1 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1406 microversion: 2.20 time: 0.174051 Jun 03 13:14:23.298024 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 380/770] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:23 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:24.320482 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cbba907e-2d51-47d3-bbb1-146a9fd6a07a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:24.321500 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cbba907e-2d51-47d3-bbb1-146a9fd6a07a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:24.324618 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:24.325681 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:24.336985 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cbba907e-2d51-47d3-bbb1-146a9fd6a07a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:24.337729 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cbba907e-2d51-47d3-bbb1-146a9fd6a07a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:24.339059 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cbba907e-2d51-47d3-bbb1-146a9fd6a07a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:24.339785 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cbba907e-2d51-47d3-bbb1-146a9fd6a07a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:24.486144 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cbba907e-2d51-47d3-bbb1-146a9fd6a07a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:24.494610 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cbba907e-2d51-47d3-bbb1-146a9fd6a07a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:24.496094 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cbba907e-2d51-47d3-bbb1-146a9fd6a07a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:24.497203 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cbba907e-2d51-47d3-bbb1-146a9fd6a07a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1406 microversion: 2.20 time: 0.184066 Jun 03 13:14:24.497759 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 391/771] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:24 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:25.519453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fc84e9f5-7a43-4a8a-9857-743fd8748c83 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:25.520445 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fc84e9f5-7a43-4a8a-9857-743fd8748c83 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:25.531866 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc84e9f5-7a43-4a8a-9857-743fd8748c83 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:25.532613 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc84e9f5-7a43-4a8a-9857-743fd8748c83 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:25.533874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc84e9f5-7a43-4a8a-9857-743fd8748c83 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:25.534642 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc84e9f5-7a43-4a8a-9857-743fd8748c83 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:25.671089 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc84e9f5-7a43-4a8a-9857-743fd8748c83 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:25.679785 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc84e9f5-7a43-4a8a-9857-743fd8748c83 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:25.681290 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc84e9f5-7a43-4a8a-9857-743fd8748c83 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:25.682437 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fc84e9f5-7a43-4a8a-9857-743fd8748c83 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1406 microversion: 2.20 time: 0.169633 Jun 03 13:14:25.682999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 381/772] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:25 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:26.700887 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-556b730b-2dd3-47a9-8ffd-674840873a0d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:26.701486 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-556b730b-2dd3-47a9-8ffd-674840873a0d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:26.707828 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-556b730b-2dd3-47a9-8ffd-674840873a0d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:26.708361 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-556b730b-2dd3-47a9-8ffd-674840873a0d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:26.709234 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-556b730b-2dd3-47a9-8ffd-674840873a0d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:26.709673 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-556b730b-2dd3-47a9-8ffd-674840873a0d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:26.850520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-556b730b-2dd3-47a9-8ffd-674840873a0d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:26.862572 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-556b730b-2dd3-47a9-8ffd-674840873a0d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:26.865152 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-556b730b-2dd3-47a9-8ffd-674840873a0d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:26.866354 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-556b730b-2dd3-47a9-8ffd-674840873a0d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1598 microversion: 2.20 time: 0.169636 Jun 03 13:14:26.866918 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 392/773] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:14:26 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1598 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:14:26.884344 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-03e74b56-f901-4090-92e1-740a9b26b814 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:26.884864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-03e74b56-f901-4090-92e1-740a9b26b814 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:26.895094 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03e74b56-f901-4090-92e1-740a9b26b814 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:26.895747 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03e74b56-f901-4090-92e1-740a9b26b814 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:26.896746 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03e74b56-f901-4090-92e1-740a9b26b814 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:26.897186 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-03e74b56-f901-4090-92e1-740a9b26b814 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:26.978589 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-03e74b56-f901-4090-92e1-740a9b26b814 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098732 Jun 03 13:14:26.979386 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 382/774] 10.222.0.58 () {60 vars in 1315 bytes} [Fri Jun 3 13:14:26 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:14:28.323945 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-ff5b2bbe-5a93-4867-9f26-6564063ed653 req-df34da83-7c81-482b-8bc3-760245a32310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7d2637b-e308-49ad-a633-946086696188", "tag": "b413ac88-a552-4af1-9a97-aa251a314588"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:28.332090 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ff5b2bbe-5a93-4867-9f26-6564063ed653 req-df34da83-7c81-482b-8bc3-760245a32310 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:28.332748 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ff5b2bbe-5a93-4867-9f26-6564063ed653 req-df34da83-7c81-482b-8bc3-760245a32310 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:28.344751 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-ff5b2bbe-5a93-4867-9f26-6564063ed653 req-df34da83-7c81-482b-8bc3-760245a32310 service nova] Creating event network-changed:b413ac88-a552-4af1-9a97-aa251a314588 for instance b7d2637b-e308-49ad-a633-946086696188 on hv-cinder-77954 Jun 03 13:14:28.352207 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-ff5b2bbe-5a93-4867-9f26-6564063ed653 req-df34da83-7c81-482b-8bc3-760245a32310 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287540 Jun 03 13:14:28.353084 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 393/775] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:31.795003 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1150030007", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2140023348", "security_groups": [{"name": "tempest-secgroup-smoke-720825641"}], "block_device_mapping_v2": [{"uuid": "9f8eac83-f6b0-4236-9de8-9df4ac812ff3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d4fbee0d-2302-4e0a-ad7f-1d9dc25e1db8"}]}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:31.913663 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] validate_networks() for [('d4fbee0d-2302-4e0a-ad7f-1d9dc25e1db8', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:14:32.684688 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:14:32.685110 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:14:32.685580 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:14:32.685979 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:14:32.686416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:14:32.695443 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:32.695891 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:32.696716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:32.697149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:32.713605 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Getting quotas for project 2fd9de1783e54cafadd25ecc97876288. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:14:32.717631 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Getting quotas for user 62f5e92899b84d5594a34643b662d233 and project 2fd9de1783e54cafadd25ecc97876288. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:14:32.779411 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:14:32.783046 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f8eac83-f6b0-4236-9de8-9df4ac812ff3',volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:14:32.934400 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a27154a7-8a21-41d1-8cab-4ff6728256a2 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.143941 Jun 03 13:14:32.935457 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 383/776] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:14:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:14:32.946135 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-579232bf-1d92-414d-bbe2-a2181d5dff63 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:32.946851 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-579232bf-1d92-414d-bbe2-a2181d5dff63 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:33.003238 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-579232bf-1d92-414d-bbe2-a2181d5dff63 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:33.010232 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-579232bf-1d92-414d-bbe2-a2181d5dff63 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1095 microversion: 2.1 time: 0.068700 Jun 03 13:14:33.010848 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 394/777] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:32 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:34.028626 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0a43a3c4-c7b2-4c85-ae45-0f2cb4330c91 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:34.029252 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0a43a3c4-c7b2-4c85-ae45-0f2cb4330c91 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:34.031198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:34.037054 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0a43a3c4-c7b2-4c85-ae45-0f2cb4330c91 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:34.037777 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0a43a3c4-c7b2-4c85-ae45-0f2cb4330c91 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:34.038592 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0a43a3c4-c7b2-4c85-ae45-0f2cb4330c91 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:34.039034 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0a43a3c4-c7b2-4c85-ae45-0f2cb4330c91 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:34.042910 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:34.115399 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0a43a3c4-c7b2-4c85-ae45-0f2cb4330c91 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:34.123912 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0a43a3c4-c7b2-4c85-ae45-0f2cb4330c91 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1201 microversion: 2.1 time: 0.100487 Jun 03 13:14:34.124990 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 384/778] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:34 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1201 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:14:35.141114 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8a78a86b-ab47-4ecf-96ca-1f4c81b905cb tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:35.141734 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8a78a86b-ab47-4ecf-96ca-1f4c81b905cb tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:35.144572 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:35.150924 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a78a86b-ab47-4ecf-96ca-1f4c81b905cb tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:35.151376 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a78a86b-ab47-4ecf-96ca-1f4c81b905cb tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:35.152175 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a78a86b-ab47-4ecf-96ca-1f4c81b905cb tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:35.152650 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a78a86b-ab47-4ecf-96ca-1f4c81b905cb tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:35.157353 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:35.306669 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-8a78a86b-ab47-4ecf-96ca-1f4c81b905cb tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:35.314695 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8a78a86b-ab47-4ecf-96ca-1f4c81b905cb tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1266 microversion: 2.1 time: 0.177406 Jun 03 13:14:35.315374 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 395/779] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:35 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:35.430457 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-2a1e0bef-3bb7-4c4c-b53e-8664e3e11110 req-0b04078f-9bc5-4115-8d1d-58f8c21325a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc45db24-e642-4aad-b751-d4d3483e8802", "tag": "a9d4c958-22b3-4655-96a7-ac94b9ef865e"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:35.441165 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-2a1e0bef-3bb7-4c4c-b53e-8664e3e11110 req-0b04078f-9bc5-4115-8d1d-58f8c21325a8 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:35.441716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-2a1e0bef-3bb7-4c4c-b53e-8664e3e11110 req-0b04078f-9bc5-4115-8d1d-58f8c21325a8 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:35.466454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-2a1e0bef-3bb7-4c4c-b53e-8664e3e11110 req-0b04078f-9bc5-4115-8d1d-58f8c21325a8 service nova] Creating event network-changed:a9d4c958-22b3-4655-96a7-ac94b9ef865e for instance dc45db24-e642-4aad-b751-d4d3483e8802 on hv-cinder-77954 Jun 03 13:14:35.472386 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-2a1e0bef-3bb7-4c4c-b53e-8664e3e11110 req-0b04078f-9bc5-4115-8d1d-58f8c21325a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045601 Jun 03 13:14:35.473338 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 385/780] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:36.336705 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-cd0961be-c084-4f2d-ada3-6046a84e0781 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:36.337556 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-cd0961be-c084-4f2d-ada3-6046a84e0781 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:36.344548 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cd0961be-c084-4f2d-ada3-6046a84e0781 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:36.345008 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cd0961be-c084-4f2d-ada3-6046a84e0781 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:36.345790 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cd0961be-c084-4f2d-ada3-6046a84e0781 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:36.346268 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-cd0961be-c084-4f2d-ada3-6046a84e0781 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:36.483544 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-cd0961be-c084-4f2d-ada3-6046a84e0781 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:36.495332 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-cd0961be-c084-4f2d-ada3-6046a84e0781 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1266 microversion: 2.1 time: 0.165218 Jun 03 13:14:36.495884 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 396/781] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:36 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:37.516264 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3ba3547f-b89e-4c75-90e2-4d001fe1f8af tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:37.517072 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3ba3547f-b89e-4c75-90e2-4d001fe1f8af tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:37.524964 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3ba3547f-b89e-4c75-90e2-4d001fe1f8af tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:37.525621 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3ba3547f-b89e-4c75-90e2-4d001fe1f8af tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:37.526554 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3ba3547f-b89e-4c75-90e2-4d001fe1f8af tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:37.527065 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3ba3547f-b89e-4c75-90e2-4d001fe1f8af tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:37.666999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3ba3547f-b89e-4c75-90e2-4d001fe1f8af tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:37.674774 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3ba3547f-b89e-4c75-90e2-4d001fe1f8af tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1266 microversion: 2.1 time: 0.164379 Jun 03 13:14:37.675348 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 386/782] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:37 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:38.692251 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e0de3063-97f8-4951-8e3e-d6cf91bf8e7d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:38.692925 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e0de3063-97f8-4951-8e3e-d6cf91bf8e7d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:38.701474 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0de3063-97f8-4951-8e3e-d6cf91bf8e7d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:38.701985 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0de3063-97f8-4951-8e3e-d6cf91bf8e7d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:38.702978 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0de3063-97f8-4951-8e3e-d6cf91bf8e7d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:38.703495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e0de3063-97f8-4951-8e3e-d6cf91bf8e7d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:38.844861 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e0de3063-97f8-4951-8e3e-d6cf91bf8e7d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:38.856055 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e0de3063-97f8-4951-8e3e-d6cf91bf8e7d tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1266 microversion: 2.1 time: 0.168285 Jun 03 13:14:38.856606 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 397/783] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:38 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:39.877823 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-18d1ee5a-52b4-4fce-914b-53aa7659a71c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:39.878795 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-18d1ee5a-52b4-4fce-914b-53aa7659a71c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:39.888720 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18d1ee5a-52b4-4fce-914b-53aa7659a71c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:39.889175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18d1ee5a-52b4-4fce-914b-53aa7659a71c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:39.889948 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18d1ee5a-52b4-4fce-914b-53aa7659a71c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:39.890420 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-18d1ee5a-52b4-4fce-914b-53aa7659a71c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:40.032116 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-18d1ee5a-52b4-4fce-914b-53aa7659a71c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:40.044421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-18d1ee5a-52b4-4fce-914b-53aa7659a71c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1266 microversion: 2.1 time: 0.172953 Jun 03 13:14:40.045243 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 387/784] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:39 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:41.063091 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-41e0ab98-7f40-4716-bc01-f03d7e545806 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:41.063678 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-41e0ab98-7f40-4716-bc01-f03d7e545806 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:41.070559 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41e0ab98-7f40-4716-bc01-f03d7e545806 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:41.071041 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41e0ab98-7f40-4716-bc01-f03d7e545806 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:41.071816 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41e0ab98-7f40-4716-bc01-f03d7e545806 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:41.072246 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-41e0ab98-7f40-4716-bc01-f03d7e545806 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:41.217621 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-41e0ab98-7f40-4716-bc01-f03d7e545806 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:41.225749 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-41e0ab98-7f40-4716-bc01-f03d7e545806 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1266 microversion: 2.1 time: 0.167418 Jun 03 13:14:41.226276 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 398/785] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:41 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:42.247418 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-68d0c7e6-3708-4b30-a447-61a6bd8a2279 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:42.248040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-68d0c7e6-3708-4b30-a447-61a6bd8a2279 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:42.255057 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68d0c7e6-3708-4b30-a447-61a6bd8a2279 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:42.255514 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68d0c7e6-3708-4b30-a447-61a6bd8a2279 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:42.256289 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68d0c7e6-3708-4b30-a447-61a6bd8a2279 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:42.256726 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-68d0c7e6-3708-4b30-a447-61a6bd8a2279 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:42.400622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-68d0c7e6-3708-4b30-a447-61a6bd8a2279 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:42.410616 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-68d0c7e6-3708-4b30-a447-61a6bd8a2279 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1266 microversion: 2.1 time: 0.168944 Jun 03 13:14:42.411399 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 388/786] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:42 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:43.433172 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c53fe9b1-6685-4604-a301-ce2dc60d6430 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:43.433875 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c53fe9b1-6685-4604-a301-ce2dc60d6430 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:43.436633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:43.442259 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c53fe9b1-6685-4604-a301-ce2dc60d6430 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:43.442730 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c53fe9b1-6685-4604-a301-ce2dc60d6430 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:43.443534 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c53fe9b1-6685-4604-a301-ce2dc60d6430 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:43.443987 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c53fe9b1-6685-4604-a301-ce2dc60d6430 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:43.597135 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c53fe9b1-6685-4604-a301-ce2dc60d6430 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:43.605753 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c53fe9b1-6685-4604-a301-ce2dc60d6430 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1266 microversion: 2.1 time: 0.176547 Jun 03 13:14:43.606388 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 399/787] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:43 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:44.624959 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c35774b8-05cd-46e4-b4dd-f9b40fcc8690 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:44.625632 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c35774b8-05cd-46e4-b4dd-f9b40fcc8690 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:44.627661 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:44.628326 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:14:44.634849 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c35774b8-05cd-46e4-b4dd-f9b40fcc8690 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:44.635306 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c35774b8-05cd-46e4-b4dd-f9b40fcc8690 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:44.636078 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c35774b8-05cd-46e4-b4dd-f9b40fcc8690 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:44.636519 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c35774b8-05cd-46e4-b4dd-f9b40fcc8690 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:44.785015 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c35774b8-05cd-46e4-b4dd-f9b40fcc8690 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:44.792749 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c35774b8-05cd-46e4-b4dd-f9b40fcc8690 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1266 microversion: 2.1 time: 0.172436 Jun 03 13:14:44.793324 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 389/788] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:44 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:45.814258 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5f634521-4a52-48a6-8688-2378f0a59ed3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:45.815086 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5f634521-4a52-48a6-8688-2378f0a59ed3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:45.825928 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f634521-4a52-48a6-8688-2378f0a59ed3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:45.826411 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f634521-4a52-48a6-8688-2378f0a59ed3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:45.827201 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f634521-4a52-48a6-8688-2378f0a59ed3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:45.827640 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5f634521-4a52-48a6-8688-2378f0a59ed3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:45.975531 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5f634521-4a52-48a6-8688-2378f0a59ed3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:45.988521 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5f634521-4a52-48a6-8688-2378f0a59ed3 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1266 microversion: 2.1 time: 0.180598 Jun 03 13:14:45.989428 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 400/789] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:45 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:47.008353 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fed40ac2-62aa-4c01-a196-b446e02290f7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:47.008981 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fed40ac2-62aa-4c01-a196-b446e02290f7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:47.018334 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fed40ac2-62aa-4c01-a196-b446e02290f7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:47.018778 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fed40ac2-62aa-4c01-a196-b446e02290f7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:47.019566 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fed40ac2-62aa-4c01-a196-b446e02290f7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:47.019995 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fed40ac2-62aa-4c01-a196-b446e02290f7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:47.037864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-f0f2316b-0c0a-4482-903f-a5e86c310cf7 req-ad7fb12e-1e18-45e1-bc08-15bfee91b581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc45db24-e642-4aad-b751-d4d3483e8802", "name": "network-vif-plugged", "status": "completed", "tag": "a9d4c958-22b3-4655-96a7-ac94b9ef865e"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:47.046087 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-f0f2316b-0c0a-4482-903f-a5e86c310cf7 req-ad7fb12e-1e18-45e1-bc08-15bfee91b581 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:47.046548 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-f0f2316b-0c0a-4482-903f-a5e86c310cf7 req-ad7fb12e-1e18-45e1-bc08-15bfee91b581 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:47.057457 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-f0f2316b-0c0a-4482-903f-a5e86c310cf7 req-ad7fb12e-1e18-45e1-bc08-15bfee91b581 service nova] Creating event network-vif-plugged:a9d4c958-22b3-4655-96a7-ac94b9ef865e for instance dc45db24-e642-4aad-b751-d4d3483e8802 on hv-cinder-77954 Jun 03 13:14:47.062554 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-f0f2316b-0c0a-4482-903f-a5e86c310cf7 req-ad7fb12e-1e18-45e1-bc08-15bfee91b581 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153417 Jun 03 13:14:47.063770 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 390/790] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:14:47.160280 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fed40ac2-62aa-4c01-a196-b446e02290f7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:47.167946 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fed40ac2-62aa-4c01-a196-b446e02290f7 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1266 microversion: 2.1 time: 0.163421 Jun 03 13:14:47.168571 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 401/791] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:47 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:14:48.188492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5c6c82d3-077f-437d-9412-2c9b3785a62e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:48.189201 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5c6c82d3-077f-437d-9412-2c9b3785a62e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:48.196060 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c6c82d3-077f-437d-9412-2c9b3785a62e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:48.196517 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c6c82d3-077f-437d-9412-2c9b3785a62e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:48.197304 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c6c82d3-077f-437d-9412-2c9b3785a62e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:48.197773 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c6c82d3-077f-437d-9412-2c9b3785a62e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:48.347278 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5c6c82d3-077f-437d-9412-2c9b3785a62e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:48.359198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5c6c82d3-077f-437d-9412-2c9b3785a62e tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1266 microversion: 2.1 time: 0.176182 Jun 03 13:14:48.359975 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 391/792] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:48 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:49.381280 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e95d355b-6e3a-43eb-9873-d0c73f223ded tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:49.382274 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e95d355b-6e3a-43eb-9873-d0c73f223ded tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:49.391314 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e95d355b-6e3a-43eb-9873-d0c73f223ded tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:49.391776 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e95d355b-6e3a-43eb-9873-d0c73f223ded tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:49.392551 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e95d355b-6e3a-43eb-9873-d0c73f223ded tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:49.393008 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e95d355b-6e3a-43eb-9873-d0c73f223ded tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:49.523614 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e95d355b-6e3a-43eb-9873-d0c73f223ded tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:49.532045 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e95d355b-6e3a-43eb-9873-d0c73f223ded tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1453 microversion: 2.1 time: 0.157070 Jun 03 13:14:49.532045 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 402/793] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:49 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:49.548671 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0501b338-8518-42cc-bd92-bb58447983aa tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:14:49.549263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0501b338-8518-42cc-bd92-bb58447983aa tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:14:49.555522 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0501b338-8518-42cc-bd92-bb58447983aa tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:49.555972 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0501b338-8518-42cc-bd92-bb58447983aa tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:49.556752 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0501b338-8518-42cc-bd92-bb58447983aa tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:49.557189 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0501b338-8518-42cc-bd92-bb58447983aa tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:49.693669 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0501b338-8518-42cc-bd92-bb58447983aa tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:14:49.705415 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0501b338-8518-42cc-bd92-bb58447983aa tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1453 microversion: 2.1 time: 0.160852 Jun 03 13:14:49.706283 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 392/794] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:14:49 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:14:51.474301 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-b0465b25-cbd2-4ad7-a12d-aca0d9bfa175 req-8731e306-6249-474e-80c9-ba88f5a07bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc45db24-e642-4aad-b751-d4d3483e8802", "tag": "a9d4c958-22b3-4655-96a7-ac94b9ef865e"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:14:51.483191 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-b0465b25-cbd2-4ad7-a12d-aca0d9bfa175 req-8731e306-6249-474e-80c9-ba88f5a07bcc service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:14:51.483692 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-b0465b25-cbd2-4ad7-a12d-aca0d9bfa175 req-8731e306-6249-474e-80c9-ba88f5a07bcc service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:14:51.495273 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-b0465b25-cbd2-4ad7-a12d-aca0d9bfa175 req-8731e306-6249-474e-80c9-ba88f5a07bcc service nova] Creating event network-changed:a9d4c958-22b3-4655-96a7-ac94b9ef865e for instance dc45db24-e642-4aad-b751-d4d3483e8802 on hv-cinder-77954 Jun 03 13:14:51.500790 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-b0465b25-cbd2-4ad7-a12d-aca0d9bfa175 req-8731e306-6249-474e-80c9-ba88f5a07bcc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030270 Jun 03 13:14:51.501370 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 403/795] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:15:43.162797 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=17 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:15:43.163560 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=45 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:15:43.269598 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-79a3c74d-7129-4d46-8bc8-6453edbe0439 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:43.270097 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-79a3c74d-7129-4d46-8bc8-6453edbe0439 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:43.276555 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79a3c74d-7129-4d46-8bc8-6453edbe0439 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:43.276997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79a3c74d-7129-4d46-8bc8-6453edbe0439 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:43.277760 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79a3c74d-7129-4d46-8bc8-6453edbe0439 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:43.278209 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79a3c74d-7129-4d46-8bc8-6453edbe0439 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:43.302275 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-79a3c74d-7129-4d46-8bc8-6453edbe0439 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/ips" status: 200 len: 151 microversion: 2.20 time: 0.145185 Jun 03 13:15:43.302813 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 393/796] 10.222.0.58 () {60 vars in 1288 bytes} [Fri Jun 3 13:15:43 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/ips => generated 151 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 13:15:45.109056 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=17 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:15:45.110270 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=49 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:15:45.116007 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fd366ff2-d32a-4644-b06e-66ba4c6c3749 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:15:45.116633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fd366ff2-d32a-4644-b06e-66ba4c6c3749 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:45.123655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd366ff2-d32a-4644-b06e-66ba4c6c3749 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:45.124110 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd366ff2-d32a-4644-b06e-66ba4c6c3749 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:45.124852 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd366ff2-d32a-4644-b06e-66ba4c6c3749 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:45.125320 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fd366ff2-d32a-4644-b06e-66ba4c6c3749 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:45.148492 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-fd366ff2-d32a-4644-b06e-66ba4c6c3749 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lazy-loading 'flavor' on Instance uuid b7d2637b-e308-49ad-a633-946086696188 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:15:45.434509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fd366ff2-d32a-4644-b06e-66ba4c6c3749 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "POST /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/action" status: 202 len: 0 microversion: 2.20 time: 0.328018 Jun 03 13:15:45.435311 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 404/797] 10.222.0.58 () {62 vars in 1318 bytes} [Fri Jun 3 13:15:45 2022] POST /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:15:45.444141 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b76efa82-e1cd-451c-9e1d-123d7043d639 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:45.444751 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b76efa82-e1cd-451c-9e1d-123d7043d639 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:45.451571 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b76efa82-e1cd-451c-9e1d-123d7043d639 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:45.452053 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b76efa82-e1cd-451c-9e1d-123d7043d639 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:45.452812 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b76efa82-e1cd-451c-9e1d-123d7043d639 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:45.453240 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b76efa82-e1cd-451c-9e1d-123d7043d639 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:45.591856 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b76efa82-e1cd-451c-9e1d-123d7043d639 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:45.600286 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b76efa82-e1cd-451c-9e1d-123d7043d639 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:45.601778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b76efa82-e1cd-451c-9e1d-123d7043d639 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:45.602993 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b76efa82-e1cd-451c-9e1d-123d7043d639 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.163054 Jun 03 13:15:45.603524 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 394/798] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:45 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:46.623710 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bbc69ae8-fac5-4fdd-ae95-3c56a0522f3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:46.624390 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bbc69ae8-fac5-4fdd-ae95-3c56a0522f3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:46.631024 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbc69ae8-fac5-4fdd-ae95-3c56a0522f3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:46.631470 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbc69ae8-fac5-4fdd-ae95-3c56a0522f3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:46.632227 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbc69ae8-fac5-4fdd-ae95-3c56a0522f3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:46.632656 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbc69ae8-fac5-4fdd-ae95-3c56a0522f3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:46.767412 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bbc69ae8-fac5-4fdd-ae95-3c56a0522f3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:46.775790 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bbc69ae8-fac5-4fdd-ae95-3c56a0522f3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:46.777330 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bbc69ae8-fac5-4fdd-ae95-3c56a0522f3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:46.778565 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bbc69ae8-fac5-4fdd-ae95-3c56a0522f3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.159717 Jun 03 13:15:46.779128 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 405/799] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:46 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:47.799796 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5ac62a22-9c6a-4b11-ba23-708d84765f56 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:47.800471 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5ac62a22-9c6a-4b11-ba23-708d84765f56 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:47.812705 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ac62a22-9c6a-4b11-ba23-708d84765f56 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:47.813730 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ac62a22-9c6a-4b11-ba23-708d84765f56 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:47.815506 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ac62a22-9c6a-4b11-ba23-708d84765f56 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:47.816530 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5ac62a22-9c6a-4b11-ba23-708d84765f56 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:47.979771 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5ac62a22-9c6a-4b11-ba23-708d84765f56 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:47.991904 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5ac62a22-9c6a-4b11-ba23-708d84765f56 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:47.993419 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5ac62a22-9c6a-4b11-ba23-708d84765f56 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:47.994619 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5ac62a22-9c6a-4b11-ba23-708d84765f56 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.200677 Jun 03 13:15:47.995186 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 395/800] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:47 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:49.016199 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-76aaead0-314f-4c9c-9d40-42aa8e230b87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:49.017207 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-76aaead0-314f-4c9c-9d40-42aa8e230b87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:49.025438 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76aaead0-314f-4c9c-9d40-42aa8e230b87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:49.025906 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76aaead0-314f-4c9c-9d40-42aa8e230b87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:49.026706 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76aaead0-314f-4c9c-9d40-42aa8e230b87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:49.027147 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-76aaead0-314f-4c9c-9d40-42aa8e230b87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:49.160392 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-76aaead0-314f-4c9c-9d40-42aa8e230b87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:49.168771 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-76aaead0-314f-4c9c-9d40-42aa8e230b87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:49.170283 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-76aaead0-314f-4c9c-9d40-42aa8e230b87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:49.171435 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-76aaead0-314f-4c9c-9d40-42aa8e230b87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.161876 Jun 03 13:15:49.171989 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 406/801] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:49 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:50.193292 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a098558f-24f9-47b3-80d6-af3d22e9a8c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:50.193906 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a098558f-24f9-47b3-80d6-af3d22e9a8c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:50.200347 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a098558f-24f9-47b3-80d6-af3d22e9a8c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:50.200936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a098558f-24f9-47b3-80d6-af3d22e9a8c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:50.201717 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a098558f-24f9-47b3-80d6-af3d22e9a8c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:50.202157 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a098558f-24f9-47b3-80d6-af3d22e9a8c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:50.341865 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a098558f-24f9-47b3-80d6-af3d22e9a8c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:50.352557 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a098558f-24f9-47b3-80d6-af3d22e9a8c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:50.354047 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a098558f-24f9-47b3-80d6-af3d22e9a8c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:50.355233 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a098558f-24f9-47b3-80d6-af3d22e9a8c9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.168111 Jun 03 13:15:50.355794 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 396/802] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:50 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:51.382989 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-dcb37fc3-d489-405e-ba16-bfe384ce246a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:51.383700 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-dcb37fc3-d489-405e-ba16-bfe384ce246a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:51.392171 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dcb37fc3-d489-405e-ba16-bfe384ce246a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:51.392757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dcb37fc3-d489-405e-ba16-bfe384ce246a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:51.393769 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dcb37fc3-d489-405e-ba16-bfe384ce246a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:51.394386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-dcb37fc3-d489-405e-ba16-bfe384ce246a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:51.530456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dcb37fc3-d489-405e-ba16-bfe384ce246a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:51.539499 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dcb37fc3-d489-405e-ba16-bfe384ce246a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:51.541029 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-dcb37fc3-d489-405e-ba16-bfe384ce246a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:51.542391 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-dcb37fc3-d489-405e-ba16-bfe384ce246a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.166129 Jun 03 13:15:51.542993 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 407/803] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:51 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:52.561198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d500c4b0-187f-4215-9adb-766b3384ef88 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:52.561812 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d500c4b0-187f-4215-9adb-766b3384ef88 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:52.569155 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d500c4b0-187f-4215-9adb-766b3384ef88 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:52.569614 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d500c4b0-187f-4215-9adb-766b3384ef88 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:52.570432 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d500c4b0-187f-4215-9adb-766b3384ef88 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:52.570868 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d500c4b0-187f-4215-9adb-766b3384ef88 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:52.706729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d500c4b0-187f-4215-9adb-766b3384ef88 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:52.715622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d500c4b0-187f-4215-9adb-766b3384ef88 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:52.717121 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d500c4b0-187f-4215-9adb-766b3384ef88 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:52.718350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d500c4b0-187f-4215-9adb-766b3384ef88 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.161273 Jun 03 13:15:52.718960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 397/804] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:52 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:53.740799 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-40863bec-288b-42ca-af55-e643657362e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:53.741523 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-40863bec-288b-42ca-af55-e643657362e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:53.750050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40863bec-288b-42ca-af55-e643657362e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:53.750625 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40863bec-288b-42ca-af55-e643657362e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:53.751596 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40863bec-288b-42ca-af55-e643657362e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:53.752131 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40863bec-288b-42ca-af55-e643657362e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:53.891208 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-40863bec-288b-42ca-af55-e643657362e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:53.900030 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-40863bec-288b-42ca-af55-e643657362e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:53.901564 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-40863bec-288b-42ca-af55-e643657362e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:53.902766 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-40863bec-288b-42ca-af55-e643657362e5 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.168589 Jun 03 13:15:53.903342 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 408/805] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:53 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:54.925297 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-879870fa-e11e-47e8-bfc6-dc23cd67ebea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:54.926192 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-879870fa-e11e-47e8-bfc6-dc23cd67ebea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:54.937456 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-879870fa-e11e-47e8-bfc6-dc23cd67ebea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:54.938270 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-879870fa-e11e-47e8-bfc6-dc23cd67ebea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:54.939578 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-879870fa-e11e-47e8-bfc6-dc23cd67ebea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:54.940305 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-879870fa-e11e-47e8-bfc6-dc23cd67ebea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:55.077192 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-879870fa-e11e-47e8-bfc6-dc23cd67ebea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:55.086080 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-879870fa-e11e-47e8-bfc6-dc23cd67ebea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:55.087613 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-879870fa-e11e-47e8-bfc6-dc23cd67ebea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:55.088799 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-879870fa-e11e-47e8-bfc6-dc23cd67ebea tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.170417 Jun 03 13:15:55.089377 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 398/806] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:54 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:56.111455 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-84071f6d-d424-4d86-b97e-3a8f5cc8e782 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:56.112514 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-84071f6d-d424-4d86-b97e-3a8f5cc8e782 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:56.120899 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84071f6d-d424-4d86-b97e-3a8f5cc8e782 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:56.121396 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84071f6d-d424-4d86-b97e-3a8f5cc8e782 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:56.122173 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84071f6d-d424-4d86-b97e-3a8f5cc8e782 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:56.122632 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-84071f6d-d424-4d86-b97e-3a8f5cc8e782 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:56.261106 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-84071f6d-d424-4d86-b97e-3a8f5cc8e782 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:56.271868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-84071f6d-d424-4d86-b97e-3a8f5cc8e782 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:56.273364 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-84071f6d-d424-4d86-b97e-3a8f5cc8e782 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:56.274565 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-84071f6d-d424-4d86-b97e-3a8f5cc8e782 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.169807 Jun 03 13:15:56.275136 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 409/807] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:56 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:57.297296 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c8582aaa-930e-4c58-9f06-c3b56df16680 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:57.298358 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c8582aaa-930e-4c58-9f06-c3b56df16680 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:57.309414 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8582aaa-930e-4c58-9f06-c3b56df16680 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:57.310179 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8582aaa-930e-4c58-9f06-c3b56df16680 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:57.311488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8582aaa-930e-4c58-9f06-c3b56df16680 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:57.312218 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c8582aaa-930e-4c58-9f06-c3b56df16680 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:57.450481 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c8582aaa-930e-4c58-9f06-c3b56df16680 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:57.458625 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c8582aaa-930e-4c58-9f06-c3b56df16680 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:57.460117 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c8582aaa-930e-4c58-9f06-c3b56df16680 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:57.461322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c8582aaa-930e-4c58-9f06-c3b56df16680 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.171009 Jun 03 13:15:57.461885 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 399/808] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:57 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:58.483172 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ffbdeb95-7899-4c58-8e5a-8e0507fc8731 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:58.483903 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ffbdeb95-7899-4c58-8e5a-8e0507fc8731 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:58.493254 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffbdeb95-7899-4c58-8e5a-8e0507fc8731 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:58.493707 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffbdeb95-7899-4c58-8e5a-8e0507fc8731 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:58.494518 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffbdeb95-7899-4c58-8e5a-8e0507fc8731 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:58.494957 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffbdeb95-7899-4c58-8e5a-8e0507fc8731 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:58.643080 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ffbdeb95-7899-4c58-8e5a-8e0507fc8731 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:58.651494 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ffbdeb95-7899-4c58-8e5a-8e0507fc8731 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:58.652988 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ffbdeb95-7899-4c58-8e5a-8e0507fc8731 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:58.654142 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ffbdeb95-7899-4c58-8e5a-8e0507fc8731 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.177499 Jun 03 13:15:58.654726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 410/809] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:58 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:15:59.675341 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-29e482cc-81d1-4b0a-a338-d81896b5df87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:15:59.675953 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-29e482cc-81d1-4b0a-a338-d81896b5df87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:15:59.684275 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-29e482cc-81d1-4b0a-a338-d81896b5df87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:59.684729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-29e482cc-81d1-4b0a-a338-d81896b5df87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:59.685508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-29e482cc-81d1-4b0a-a338-d81896b5df87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:15:59.685944 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-29e482cc-81d1-4b0a-a338-d81896b5df87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:15:59.820001 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-29e482cc-81d1-4b0a-a338-d81896b5df87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:59.828080 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-29e482cc-81d1-4b0a-a338-d81896b5df87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:59.829581 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-29e482cc-81d1-4b0a-a338-d81896b5df87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:15:59.830795 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-29e482cc-81d1-4b0a-a338-d81896b5df87 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.161617 Jun 03 13:15:59.831366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 400/810] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:15:59 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:00.852932 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c78fe6ae-b801-4f42-bbdc-88baf4ff1d63 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:00.853542 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c78fe6ae-b801-4f42-bbdc-88baf4ff1d63 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:00.861824 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c78fe6ae-b801-4f42-bbdc-88baf4ff1d63 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:00.862375 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c78fe6ae-b801-4f42-bbdc-88baf4ff1d63 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:00.863668 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c78fe6ae-b801-4f42-bbdc-88baf4ff1d63 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:00.864179 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c78fe6ae-b801-4f42-bbdc-88baf4ff1d63 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:01.008931 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c78fe6ae-b801-4f42-bbdc-88baf4ff1d63 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:01.017224 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c78fe6ae-b801-4f42-bbdc-88baf4ff1d63 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:01.018758 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c78fe6ae-b801-4f42-bbdc-88baf4ff1d63 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:01.019899 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c78fe6ae-b801-4f42-bbdc-88baf4ff1d63 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.173519 Jun 03 13:16:01.020448 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 411/811] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:00 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:02.039765 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-04cb62a3-900b-4c30-a823-35d043dcf6ec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:02.040345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-04cb62a3-900b-4c30-a823-35d043dcf6ec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:02.047371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04cb62a3-900b-4c30-a823-35d043dcf6ec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:02.047826 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04cb62a3-900b-4c30-a823-35d043dcf6ec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:02.048607 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04cb62a3-900b-4c30-a823-35d043dcf6ec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:02.049042 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04cb62a3-900b-4c30-a823-35d043dcf6ec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:02.183990 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-04cb62a3-900b-4c30-a823-35d043dcf6ec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:02.192072 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-04cb62a3-900b-4c30-a823-35d043dcf6ec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:02.193642 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-04cb62a3-900b-4c30-a823-35d043dcf6ec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:02.195055 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-04cb62a3-900b-4c30-a823-35d043dcf6ec tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1743 microversion: 2.20 time: 0.159944 Jun 03 13:16:02.195621 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 401/812] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:02 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:03.219186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-56772082-5321-43da-a934-ee4fe67f1eef tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:03.220177 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-56772082-5321-43da-a934-ee4fe67f1eef tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:03.231593 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56772082-5321-43da-a934-ee4fe67f1eef tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:03.232351 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56772082-5321-43da-a934-ee4fe67f1eef tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:03.233635 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56772082-5321-43da-a934-ee4fe67f1eef tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:03.234418 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56772082-5321-43da-a934-ee4fe67f1eef tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:03.384260 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-56772082-5321-43da-a934-ee4fe67f1eef tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:03.392565 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-56772082-5321-43da-a934-ee4fe67f1eef tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:03.394059 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-56772082-5321-43da-a934-ee4fe67f1eef tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:03.395241 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-56772082-5321-43da-a934-ee4fe67f1eef tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1743 microversion: 2.20 time: 0.182727 Jun 03 13:16:03.395802 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 412/813] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:03 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:04.418175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b32d8851-85b8-4011-99d6-0da62a0b8098 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:04.419170 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b32d8851-85b8-4011-99d6-0da62a0b8098 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:04.430362 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b32d8851-85b8-4011-99d6-0da62a0b8098 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:04.431102 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b32d8851-85b8-4011-99d6-0da62a0b8098 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:04.432360 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b32d8851-85b8-4011-99d6-0da62a0b8098 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:04.433076 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b32d8851-85b8-4011-99d6-0da62a0b8098 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:04.583660 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b32d8851-85b8-4011-99d6-0da62a0b8098 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:04.593321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b32d8851-85b8-4011-99d6-0da62a0b8098 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:04.594883 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b32d8851-85b8-4011-99d6-0da62a0b8098 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:04.596059 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b32d8851-85b8-4011-99d6-0da62a0b8098 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1743 microversion: 2.20 time: 0.184794 Jun 03 13:16:04.596633 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 402/814] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:04 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1743 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:05.615530 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-93a28bab-c4de-4168-9a16-43da839d5f23 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:05.616147 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-93a28bab-c4de-4168-9a16-43da839d5f23 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:05.624589 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93a28bab-c4de-4168-9a16-43da839d5f23 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:05.625229 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93a28bab-c4de-4168-9a16-43da839d5f23 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:05.626308 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93a28bab-c4de-4168-9a16-43da839d5f23 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:05.626797 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-93a28bab-c4de-4168-9a16-43da839d5f23 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:05.760479 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-93a28bab-c4de-4168-9a16-43da839d5f23 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:05.772861 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-93a28bab-c4de-4168-9a16-43da839d5f23 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:05.775145 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-93a28bab-c4de-4168-9a16-43da839d5f23 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:05.776930 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-93a28bab-c4de-4168-9a16-43da839d5f23 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1743 microversion: 2.20 time: 0.166515 Jun 03 13:16:05.777735 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 413/815] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:05 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:06.802886 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-04ca2d75-41d2-4067-a909-77ffcf51787d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:06.803701 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-04ca2d75-41d2-4067-a909-77ffcf51787d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:06.811300 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04ca2d75-41d2-4067-a909-77ffcf51787d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:06.811745 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04ca2d75-41d2-4067-a909-77ffcf51787d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:06.812506 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04ca2d75-41d2-4067-a909-77ffcf51787d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:06.812939 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-04ca2d75-41d2-4067-a909-77ffcf51787d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:06.954851 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-04ca2d75-41d2-4067-a909-77ffcf51787d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:06.964908 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-04ca2d75-41d2-4067-a909-77ffcf51787d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:06.966446 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-04ca2d75-41d2-4067-a909-77ffcf51787d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:06.967633 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-04ca2d75-41d2-4067-a909-77ffcf51787d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1743 microversion: 2.20 time: 0.171020 Jun 03 13:16:06.968177 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 403/816] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:06 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:07.473677 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-1ea52b00-57b2-4916-be43-f62605e026a2 req-a7b07be4-7999-4328-a55b-8541a247ecc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d2637b-e308-49ad-a633-946086696188", "name": "network-vif-plugged", "status": "completed", "tag": "b413ac88-a552-4af1-9a97-aa251a314588"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:16:07.483330 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1ea52b00-57b2-4916-be43-f62605e026a2 req-a7b07be4-7999-4328-a55b-8541a247ecc8 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:07.483757 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1ea52b00-57b2-4916-be43-f62605e026a2 req-a7b07be4-7999-4328-a55b-8541a247ecc8 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:07.495815 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-1ea52b00-57b2-4916-be43-f62605e026a2 req-a7b07be4-7999-4328-a55b-8541a247ecc8 service nova] Creating event network-vif-plugged:b413ac88-a552-4af1-9a97-aa251a314588 for instance b7d2637b-e308-49ad-a633-946086696188 on hv-cinder-77954 Jun 03 13:16:07.501072 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-1ea52b00-57b2-4916-be43-f62605e026a2 req-a7b07be4-7999-4328-a55b-8541a247ecc8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031420 Jun 03 13:16:07.501682 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 414/817] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:16:07.989542 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d7b6908b-3cd5-4608-b04a-d2bd07bcc047 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:07.990489 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d7b6908b-3cd5-4608-b04a-d2bd07bcc047 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:08.000867 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7b6908b-3cd5-4608-b04a-d2bd07bcc047 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:08.001569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7b6908b-3cd5-4608-b04a-d2bd07bcc047 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:08.002820 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7b6908b-3cd5-4608-b04a-d2bd07bcc047 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:08.003497 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7b6908b-3cd5-4608-b04a-d2bd07bcc047 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:08.157456 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d7b6908b-3cd5-4608-b04a-d2bd07bcc047 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:08.166373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d7b6908b-3cd5-4608-b04a-d2bd07bcc047 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:08.167882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d7b6908b-3cd5-4608-b04a-d2bd07bcc047 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:08.169058 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d7b6908b-3cd5-4608-b04a-d2bd07bcc047 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1743 microversion: 2.20 time: 0.186229 Jun 03 13:16:08.169681 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 404/818] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:07 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 13:16:09.188372 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-26da35ce-f29b-4aff-997d-111dafebec75 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:09.189085 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-26da35ce-f29b-4aff-997d-111dafebec75 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:09.195765 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26da35ce-f29b-4aff-997d-111dafebec75 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:09.196228 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26da35ce-f29b-4aff-997d-111dafebec75 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:09.197010 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26da35ce-f29b-4aff-997d-111dafebec75 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:09.197453 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26da35ce-f29b-4aff-997d-111dafebec75 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:09.357462 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-26da35ce-f29b-4aff-997d-111dafebec75 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:09.368086 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-26da35ce-f29b-4aff-997d-111dafebec75 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:09.369989 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-26da35ce-f29b-4aff-997d-111dafebec75 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:09.371209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-26da35ce-f29b-4aff-997d-111dafebec75 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1738 microversion: 2.20 time: 0.187672 Jun 03 13:16:09.371773 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 415/819] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:09 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:10.390440 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-35338863-166d-4435-b1c1-6890e752e748 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:10.391729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-35338863-166d-4435-b1c1-6890e752e748 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:10.400150 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-35338863-166d-4435-b1c1-6890e752e748 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:10.400913 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-35338863-166d-4435-b1c1-6890e752e748 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:10.401700 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-35338863-166d-4435-b1c1-6890e752e748 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:10.402136 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-35338863-166d-4435-b1c1-6890e752e748 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:10.566052 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-35338863-166d-4435-b1c1-6890e752e748 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:10.578103 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-35338863-166d-4435-b1c1-6890e752e748 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:10.580095 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-35338863-166d-4435-b1c1-6890e752e748 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:10.581499 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-35338863-166d-4435-b1c1-6890e752e748 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1738 microversion: 2.20 time: 0.195339 Jun 03 13:16:10.592233 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 405/820] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:10 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1738 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:11.600016 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-342a63aa-018a-40dc-9735-247ebc528cdb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:11.601062 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-342a63aa-018a-40dc-9735-247ebc528cdb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:11.608659 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-342a63aa-018a-40dc-9735-247ebc528cdb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:11.609110 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-342a63aa-018a-40dc-9735-247ebc528cdb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:11.609917 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-342a63aa-018a-40dc-9735-247ebc528cdb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:11.610397 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-342a63aa-018a-40dc-9735-247ebc528cdb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:11.764602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-342a63aa-018a-40dc-9735-247ebc528cdb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:11.775971 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-342a63aa-018a-40dc-9735-247ebc528cdb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:11.777630 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-342a63aa-018a-40dc-9735-247ebc528cdb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:11.778872 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-342a63aa-018a-40dc-9735-247ebc528cdb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1738 microversion: 2.20 time: 0.182988 Jun 03 13:16:11.779603 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 416/821] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:11 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:12.797290 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-63df9982-f8f5-4770-b7a8-6ed2dac5a147 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:12.797887 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-63df9982-f8f5-4770-b7a8-6ed2dac5a147 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:12.806981 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63df9982-f8f5-4770-b7a8-6ed2dac5a147 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:12.807736 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63df9982-f8f5-4770-b7a8-6ed2dac5a147 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:12.808557 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63df9982-f8f5-4770-b7a8-6ed2dac5a147 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:12.809050 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-63df9982-f8f5-4770-b7a8-6ed2dac5a147 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:12.967894 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-63df9982-f8f5-4770-b7a8-6ed2dac5a147 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:12.979712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-63df9982-f8f5-4770-b7a8-6ed2dac5a147 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:12.981673 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-63df9982-f8f5-4770-b7a8-6ed2dac5a147 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:12.983079 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-63df9982-f8f5-4770-b7a8-6ed2dac5a147 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1738 microversion: 2.20 time: 0.189968 Jun 03 13:16:12.983859 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 406/822] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:12 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:14.002056 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-79cf2528-59de-4bfa-af11-3d2bc509389b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:14.003369 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-79cf2528-59de-4bfa-af11-3d2bc509389b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:14.010611 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79cf2528-59de-4bfa-af11-3d2bc509389b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:14.011371 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79cf2528-59de-4bfa-af11-3d2bc509389b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:14.012398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79cf2528-59de-4bfa-af11-3d2bc509389b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:14.013058 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-79cf2528-59de-4bfa-af11-3d2bc509389b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:14.168228 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-79cf2528-59de-4bfa-af11-3d2bc509389b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:14.177451 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-79cf2528-59de-4bfa-af11-3d2bc509389b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:14.179093 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-79cf2528-59de-4bfa-af11-3d2bc509389b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:14.180475 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-79cf2528-59de-4bfa-af11-3d2bc509389b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1738 microversion: 2.20 time: 0.182296 Jun 03 13:16:14.181066 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 417/823] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:13 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:15.226778 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2209b9e5-8e59-4d23-b7aa-4cf3d69e8507 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:15.227415 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2209b9e5-8e59-4d23-b7aa-4cf3d69e8507 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:15.230103 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=29 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:15.237193 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2209b9e5-8e59-4d23-b7aa-4cf3d69e8507 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:15.237639 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2209b9e5-8e59-4d23-b7aa-4cf3d69e8507 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:15.238806 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2209b9e5-8e59-4d23-b7aa-4cf3d69e8507 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:15.239255 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2209b9e5-8e59-4d23-b7aa-4cf3d69e8507 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:15.243087 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=83 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:15.411107 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2209b9e5-8e59-4d23-b7aa-4cf3d69e8507 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:15.422530 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2209b9e5-8e59-4d23-b7aa-4cf3d69e8507 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:15.424020 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2209b9e5-8e59-4d23-b7aa-4cf3d69e8507 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:15.425340 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2209b9e5-8e59-4d23-b7aa-4cf3d69e8507 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1738 microversion: 2.20 time: 0.229096 Jun 03 13:16:15.425905 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 407/824] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:15 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:16.447832 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bb2d9f2e-05fe-4edb-9822-359e706adf64 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:16.448606 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bb2d9f2e-05fe-4edb-9822-359e706adf64 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:16.456755 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=29 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:16.458284 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bb2d9f2e-05fe-4edb-9822-359e706adf64 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:16.458760 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bb2d9f2e-05fe-4edb-9822-359e706adf64 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:16.459540 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bb2d9f2e-05fe-4edb-9822-359e706adf64 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:16.459959 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bb2d9f2e-05fe-4edb-9822-359e706adf64 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:16.464055 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:16.607621 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bb2d9f2e-05fe-4edb-9822-359e706adf64 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:16.618547 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bb2d9f2e-05fe-4edb-9822-359e706adf64 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:16.620150 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bb2d9f2e-05fe-4edb-9822-359e706adf64 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:16.621583 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bb2d9f2e-05fe-4edb-9822-359e706adf64 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1738 microversion: 2.20 time: 0.178589 Jun 03 13:16:16.632501 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 418/825] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:16 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:17.641706 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-979e46b5-a493-44a7-b8d4-b20b43bcff7c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:17.642364 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-979e46b5-a493-44a7-b8d4-b20b43bcff7c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:17.649162 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-979e46b5-a493-44a7-b8d4-b20b43bcff7c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:17.649619 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-979e46b5-a493-44a7-b8d4-b20b43bcff7c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:17.650548 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-979e46b5-a493-44a7-b8d4-b20b43bcff7c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:17.650990 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-979e46b5-a493-44a7-b8d4-b20b43bcff7c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:17.784988 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-979e46b5-a493-44a7-b8d4-b20b43bcff7c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:17.793100 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-979e46b5-a493-44a7-b8d4-b20b43bcff7c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:17.794631 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-979e46b5-a493-44a7-b8d4-b20b43bcff7c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:17.795796 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-979e46b5-a493-44a7-b8d4-b20b43bcff7c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1738 microversion: 2.20 time: 0.159062 Jun 03 13:16:17.796379 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 408/826] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:17 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:18.820684 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fe44d8a9-1db7-4c63-b3e0-bbef4a6db75a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:18.821260 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fe44d8a9-1db7-4c63-b3e0-bbef4a6db75a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:18.828269 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fe44d8a9-1db7-4c63-b3e0-bbef4a6db75a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:18.828719 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fe44d8a9-1db7-4c63-b3e0-bbef4a6db75a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:18.829502 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fe44d8a9-1db7-4c63-b3e0-bbef4a6db75a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:18.829938 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fe44d8a9-1db7-4c63-b3e0-bbef4a6db75a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:18.966689 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fe44d8a9-1db7-4c63-b3e0-bbef4a6db75a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:18.974824 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fe44d8a9-1db7-4c63-b3e0-bbef4a6db75a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:18.976569 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fe44d8a9-1db7-4c63-b3e0-bbef4a6db75a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:18.977827 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fe44d8a9-1db7-4c63-b3e0-bbef4a6db75a tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1720 microversion: 2.20 time: 0.161707 Jun 03 13:16:18.978393 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 419/827] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:18 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:19.997169 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b8dff999-ebae-4f1c-a1e4-9484c6a3b224 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:19.997776 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b8dff999-ebae-4f1c-a1e4-9484c6a3b224 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:20.004452 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8dff999-ebae-4f1c-a1e4-9484c6a3b224 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:20.004913 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8dff999-ebae-4f1c-a1e4-9484c6a3b224 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:20.005684 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8dff999-ebae-4f1c-a1e4-9484c6a3b224 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:20.006143 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8dff999-ebae-4f1c-a1e4-9484c6a3b224 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:20.149848 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b8dff999-ebae-4f1c-a1e4-9484c6a3b224 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:20.162659 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b8dff999-ebae-4f1c-a1e4-9484c6a3b224 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:20.164380 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b8dff999-ebae-4f1c-a1e4-9484c6a3b224 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:20.165547 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b8dff999-ebae-4f1c-a1e4-9484c6a3b224 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1720 microversion: 2.20 time: 0.172456 Jun 03 13:16:20.166137 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 409/828] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:19 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:21.184670 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1581c52f-bde8-41dd-a87d-b5a3e8d50ab6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:21.185260 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1581c52f-bde8-41dd-a87d-b5a3e8d50ab6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:21.193584 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1581c52f-bde8-41dd-a87d-b5a3e8d50ab6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:21.194035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1581c52f-bde8-41dd-a87d-b5a3e8d50ab6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:21.194845 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1581c52f-bde8-41dd-a87d-b5a3e8d50ab6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:21.195303 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1581c52f-bde8-41dd-a87d-b5a3e8d50ab6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:21.336649 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1581c52f-bde8-41dd-a87d-b5a3e8d50ab6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:21.344891 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1581c52f-bde8-41dd-a87d-b5a3e8d50ab6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:21.346397 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1581c52f-bde8-41dd-a87d-b5a3e8d50ab6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:21.347550 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1581c52f-bde8-41dd-a87d-b5a3e8d50ab6 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1723 microversion: 2.20 time: 0.167000 Jun 03 13:16:21.348126 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 420/829] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:21 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:21.365982 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-273bde8f-0365-4edb-b8fd-ec7acf6449af tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cb8b50c-f26d-4a30-8d07-7f5231d11bfb"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:16:21.367158 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-273bde8f-0365-4edb-b8fd-ec7acf6449af tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:21.375111 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-273bde8f-0365-4edb-b8fd-ec7acf6449af tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:21.375563 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-273bde8f-0365-4edb-b8fd-ec7acf6449af tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:21.376380 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-273bde8f-0365-4edb-b8fd-ec7acf6449af tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:21.376868 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-273bde8f-0365-4edb-b8fd-ec7acf6449af tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:21.517200 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-a2f92f2a-ff13-401f-9624-ef6ce6993b70 req-14d1e2fd-8028-4213-89c2-3bc9be994132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d2637b-e308-49ad-a633-946086696188", "name": "network-vif-unplugged", "status": "completed", "tag": "b413ac88-a552-4af1-9a97-aa251a314588"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:16:21.525755 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a2f92f2a-ff13-401f-9624-ef6ce6993b70 req-14d1e2fd-8028-4213-89c2-3bc9be994132 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:21.526241 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a2f92f2a-ff13-401f-9624-ef6ce6993b70 req-14d1e2fd-8028-4213-89c2-3bc9be994132 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:21.548681 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.compute.server_external_events [req-a2f92f2a-ff13-401f-9624-ef6ce6993b70 req-14d1e2fd-8028-4213-89c2-3bc9be994132 service nova] Unable to find a host for instance b7d2637b-e308-49ad-a633-946086696188. Dropping event network-vif-unplugged {{(pid=117727) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 03 13:16:21.549630 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-a2f92f2a-ff13-401f-9624-ef6ce6993b70 req-14d1e2fd-8028-4213-89c2-3bc9be994132 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036900 Jun 03 13:16:21.550258 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 421/830] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 03 13:16:21.691577 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-273bde8f-0365-4edb-b8fd-ec7acf6449af tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "POST /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.329833 Jun 03 13:16:21.692473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 410/831] 10.222.0.58 () {62 vars in 1363 bytes} [Fri Jun 3 13:16:21 2022] POST /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/os-volume_attachments => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 13:16:21.808538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fa9a9bf4-b39d-424d-8e7c-b7f3ef2e9b3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:21.809030 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fa9a9bf4-b39d-424d-8e7c-b7f3ef2e9b3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:21.815293 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa9a9bf4-b39d-424d-8e7c-b7f3ef2e9b3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:21.815730 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa9a9bf4-b39d-424d-8e7c-b7f3ef2e9b3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:21.816487 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa9a9bf4-b39d-424d-8e7c-b7f3ef2e9b3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:21.816911 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa9a9bf4-b39d-424d-8e7c-b7f3ef2e9b3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:22.080995 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fa9a9bf4-b39d-424d-8e7c-b7f3ef2e9b3c tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/os-volume_attachments/8cb8b50c-f26d-4a30-8d07-7f5231d11bfb" status: 202 len: 0 microversion: 2.20 time: 0.276781 Jun 03 13:16:22.081574 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 422/832] 10.222.0.58 () {60 vars in 1456 bytes} [Fri Jun 3 13:16:21 2022] DELETE /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/os-volume_attachments/8cb8b50c-f26d-4a30-8d07-7f5231d11bfb => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:16:22.137444 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-53568b1e-076e-4dec-8f94-0fef92a3e082 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:16:22.137937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-53568b1e-076e-4dec-8f94-0fef92a3e082 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:22.144282 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-53568b1e-076e-4dec-8f94-0fef92a3e082 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:22.144787 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-53568b1e-076e-4dec-8f94-0fef92a3e082 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:22.145617 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-53568b1e-076e-4dec-8f94-0fef92a3e082 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:22.146059 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-53568b1e-076e-4dec-8f94-0fef92a3e082 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:22.252983 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-53568b1e-076e-4dec-8f94-0fef92a3e082 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "POST /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/action" status: 202 len: 0 microversion: 2.20 time: 0.119797 Jun 03 13:16:22.253597 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 411/833] 10.222.0.58 () {62 vars in 1318 bytes} [Fri Jun 3 13:16:22 2022] POST /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:16:22.261949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5edf5ae2-3470-4bfb-8c2d-bcace6ee028f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:22.262715 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5edf5ae2-3470-4bfb-8c2d-bcace6ee028f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:22.269852 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5edf5ae2-3470-4bfb-8c2d-bcace6ee028f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:22.270334 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5edf5ae2-3470-4bfb-8c2d-bcace6ee028f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:22.271081 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5edf5ae2-3470-4bfb-8c2d-bcace6ee028f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:22.271511 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5edf5ae2-3470-4bfb-8c2d-bcace6ee028f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:22.407035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5edf5ae2-3470-4bfb-8c2d-bcace6ee028f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:22.415117 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5edf5ae2-3470-4bfb-8c2d-bcace6ee028f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:22.416943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5edf5ae2-3470-4bfb-8c2d-bcace6ee028f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:22.418105 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5edf5ae2-3470-4bfb-8c2d-bcace6ee028f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1671 microversion: 2.20 time: 0.160369 Jun 03 13:16:22.418686 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 423/834] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:22 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:23.438459 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2779ef3e-86f6-45fc-87cf-1c1d33cdd19b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:23.439099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2779ef3e-86f6-45fc-87cf-1c1d33cdd19b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:23.446755 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2779ef3e-86f6-45fc-87cf-1c1d33cdd19b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:23.447079 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2779ef3e-86f6-45fc-87cf-1c1d33cdd19b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:23.447949 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2779ef3e-86f6-45fc-87cf-1c1d33cdd19b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:23.448391 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2779ef3e-86f6-45fc-87cf-1c1d33cdd19b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:23.592098 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2779ef3e-86f6-45fc-87cf-1c1d33cdd19b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:23.600207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2779ef3e-86f6-45fc-87cf-1c1d33cdd19b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:23.601701 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2779ef3e-86f6-45fc-87cf-1c1d33cdd19b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:23.603579 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2779ef3e-86f6-45fc-87cf-1c1d33cdd19b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.170281 Jun 03 13:16:23.604150 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 412/835] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:23 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:24.623650 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-014c139d-5853-44b8-9643-6338585b4266 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:24.625287 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-014c139d-5853-44b8-9643-6338585b4266 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:24.636295 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-014c139d-5853-44b8-9643-6338585b4266 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:24.640593 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-014c139d-5853-44b8-9643-6338585b4266 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:24.641632 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-014c139d-5853-44b8-9643-6338585b4266 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:24.642335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-014c139d-5853-44b8-9643-6338585b4266 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:24.811838 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-014c139d-5853-44b8-9643-6338585b4266 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:24.822296 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-014c139d-5853-44b8-9643-6338585b4266 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:24.824334 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-014c139d-5853-44b8-9643-6338585b4266 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:24.825726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-014c139d-5853-44b8-9643-6338585b4266 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.207030 Jun 03 13:16:24.826332 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 424/836] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:24 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:25.844338 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0d224cc5-7774-46e2-af74-6215258a800f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:25.845602 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0d224cc5-7774-46e2-af74-6215258a800f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:25.852341 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d224cc5-7774-46e2-af74-6215258a800f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:25.853282 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d224cc5-7774-46e2-af74-6215258a800f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:25.854300 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d224cc5-7774-46e2-af74-6215258a800f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:25.854897 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d224cc5-7774-46e2-af74-6215258a800f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:25.999945 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0d224cc5-7774-46e2-af74-6215258a800f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:26.008418 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0d224cc5-7774-46e2-af74-6215258a800f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:26.010611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0d224cc5-7774-46e2-af74-6215258a800f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:26.011810 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0d224cc5-7774-46e2-af74-6215258a800f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.171590 Jun 03 13:16:26.012613 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 413/837] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:25 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:27.031107 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2a57064c-b0e9-406c-aa25-c733b2b5d210 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:27.032606 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2a57064c-b0e9-406c-aa25-c733b2b5d210 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:27.041134 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a57064c-b0e9-406c-aa25-c733b2b5d210 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:27.041373 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a57064c-b0e9-406c-aa25-c733b2b5d210 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:27.042218 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a57064c-b0e9-406c-aa25-c733b2b5d210 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:27.042944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2a57064c-b0e9-406c-aa25-c733b2b5d210 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:27.447404 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2a57064c-b0e9-406c-aa25-c733b2b5d210 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:27.455264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2a57064c-b0e9-406c-aa25-c733b2b5d210 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:27.456751 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2a57064c-b0e9-406c-aa25-c733b2b5d210 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:27.457905 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2a57064c-b0e9-406c-aa25-c733b2b5d210 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.431523 Jun 03 13:16:27.458500 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 425/838] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:27 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:28.478980 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-05188274-b7ab-412a-901a-b413594927b9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:28.480049 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-05188274-b7ab-412a-901a-b413594927b9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:28.491363 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05188274-b7ab-412a-901a-b413594927b9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:28.492115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05188274-b7ab-412a-901a-b413594927b9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:28.493582 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05188274-b7ab-412a-901a-b413594927b9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:28.494333 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-05188274-b7ab-412a-901a-b413594927b9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:28.648304 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-05188274-b7ab-412a-901a-b413594927b9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:28.657534 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-05188274-b7ab-412a-901a-b413594927b9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:28.659447 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-05188274-b7ab-412a-901a-b413594927b9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:28.660889 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-05188274-b7ab-412a-901a-b413594927b9 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.188422 Jun 03 13:16:28.671961 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 414/839] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:28 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:29.680397 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-b587013a-f08c-44e7-bdd9-93d087390ff4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:29.681079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-b587013a-f08c-44e7-bdd9-93d087390ff4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:29.688082 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b587013a-f08c-44e7-bdd9-93d087390ff4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:29.688569 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b587013a-f08c-44e7-bdd9-93d087390ff4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:29.689357 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b587013a-f08c-44e7-bdd9-93d087390ff4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:29.689794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-b587013a-f08c-44e7-bdd9-93d087390ff4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:29.829217 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b587013a-f08c-44e7-bdd9-93d087390ff4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:29.837929 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b587013a-f08c-44e7-bdd9-93d087390ff4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:29.839474 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-b587013a-f08c-44e7-bdd9-93d087390ff4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:29.840657 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-b587013a-f08c-44e7-bdd9-93d087390ff4 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.164373 Jun 03 13:16:29.841222 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 426/840] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:29 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:30.859613 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-471ddfe1-df29-4327-b326-cc5bc88a7953 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:30.860220 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-471ddfe1-df29-4327-b326-cc5bc88a7953 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:30.867421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-471ddfe1-df29-4327-b326-cc5bc88a7953 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:30.867876 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-471ddfe1-df29-4327-b326-cc5bc88a7953 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:30.868840 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-471ddfe1-df29-4327-b326-cc5bc88a7953 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:30.869289 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-471ddfe1-df29-4327-b326-cc5bc88a7953 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:31.015529 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-471ddfe1-df29-4327-b326-cc5bc88a7953 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:31.024092 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-471ddfe1-df29-4327-b326-cc5bc88a7953 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:31.026013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-471ddfe1-df29-4327-b326-cc5bc88a7953 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:31.027210 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-471ddfe1-df29-4327-b326-cc5bc88a7953 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.171756 Jun 03 13:16:31.027774 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 415/841] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:30 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:32.045910 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d887c0af-e47d-4e0a-a9ee-56e7978d4a57 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:32.046535 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d887c0af-e47d-4e0a-a9ee-56e7978d4a57 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:32.056816 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d887c0af-e47d-4e0a-a9ee-56e7978d4a57 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:32.057432 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d887c0af-e47d-4e0a-a9ee-56e7978d4a57 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:32.058558 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d887c0af-e47d-4e0a-a9ee-56e7978d4a57 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:32.059095 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d887c0af-e47d-4e0a-a9ee-56e7978d4a57 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:32.210647 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d887c0af-e47d-4e0a-a9ee-56e7978d4a57 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:32.219816 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d887c0af-e47d-4e0a-a9ee-56e7978d4a57 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:32.221322 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d887c0af-e47d-4e0a-a9ee-56e7978d4a57 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:32.222523 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d887c0af-e47d-4e0a-a9ee-56e7978d4a57 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.181327 Jun 03 13:16:32.223088 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 427/842] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:32 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:33.241937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6cb3145b-0893-4b74-bacb-b5886b836878 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:33.242537 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6cb3145b-0893-4b74-bacb-b5886b836878 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:33.249992 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6cb3145b-0893-4b74-bacb-b5886b836878 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:33.250496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6cb3145b-0893-4b74-bacb-b5886b836878 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:33.251257 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6cb3145b-0893-4b74-bacb-b5886b836878 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:33.251692 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6cb3145b-0893-4b74-bacb-b5886b836878 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:33.392001 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6cb3145b-0893-4b74-bacb-b5886b836878 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:33.404835 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6cb3145b-0893-4b74-bacb-b5886b836878 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:33.407406 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6cb3145b-0893-4b74-bacb-b5886b836878 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:33.409308 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6cb3145b-0893-4b74-bacb-b5886b836878 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.171911 Jun 03 13:16:33.410232 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 416/843] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:33 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:34.430790 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d62893c4-4dc4-4657-a1a1-afcf388c0135 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:34.431428 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d62893c4-4dc4-4657-a1a1-afcf388c0135 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:34.438938 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d62893c4-4dc4-4657-a1a1-afcf388c0135 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:34.439467 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d62893c4-4dc4-4657-a1a1-afcf388c0135 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:34.440561 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d62893c4-4dc4-4657-a1a1-afcf388c0135 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:34.441113 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d62893c4-4dc4-4657-a1a1-afcf388c0135 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:34.579956 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d62893c4-4dc4-4657-a1a1-afcf388c0135 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:34.590610 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d62893c4-4dc4-4657-a1a1-afcf388c0135 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:34.592092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d62893c4-4dc4-4657-a1a1-afcf388c0135 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:34.593245 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d62893c4-4dc4-4657-a1a1-afcf388c0135 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.167295 Jun 03 13:16:34.593804 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 428/844] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:34 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:35.616963 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-268390d2-7d13-4e0c-bc9a-5daa43eed57e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:35.617997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-268390d2-7d13-4e0c-bc9a-5daa43eed57e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:35.630616 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-268390d2-7d13-4e0c-bc9a-5daa43eed57e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:35.630616 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-268390d2-7d13-4e0c-bc9a-5daa43eed57e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:35.631923 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-268390d2-7d13-4e0c-bc9a-5daa43eed57e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:35.632638 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-268390d2-7d13-4e0c-bc9a-5daa43eed57e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:35.779951 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-268390d2-7d13-4e0c-bc9a-5daa43eed57e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:35.788317 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-268390d2-7d13-4e0c-bc9a-5daa43eed57e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:35.789827 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-268390d2-7d13-4e0c-bc9a-5daa43eed57e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:35.791125 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-268390d2-7d13-4e0c-bc9a-5daa43eed57e tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.181206 Jun 03 13:16:35.791686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 417/845] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:35 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:36.813416 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ea1420b9-b3d5-43af-b868-50f99c5a4861 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:36.814379 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ea1420b9-b3d5-43af-b868-50f99c5a4861 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:36.825971 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea1420b9-b3d5-43af-b868-50f99c5a4861 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:36.826781 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea1420b9-b3d5-43af-b868-50f99c5a4861 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:36.828071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea1420b9-b3d5-43af-b868-50f99c5a4861 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:36.828799 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ea1420b9-b3d5-43af-b868-50f99c5a4861 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:36.967601 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ea1420b9-b3d5-43af-b868-50f99c5a4861 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:36.980199 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ea1420b9-b3d5-43af-b868-50f99c5a4861 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:36.982623 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ea1420b9-b3d5-43af-b868-50f99c5a4861 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:36.984454 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ea1420b9-b3d5-43af-b868-50f99c5a4861 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.177764 Jun 03 13:16:36.985298 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 429/846] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:36 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:38.003638 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6c2067ae-6f7c-4551-adda-47829f1d80b2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:38.004406 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6c2067ae-6f7c-4551-adda-47829f1d80b2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:38.011680 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c2067ae-6f7c-4551-adda-47829f1d80b2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:38.012233 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c2067ae-6f7c-4551-adda-47829f1d80b2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:38.013100 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c2067ae-6f7c-4551-adda-47829f1d80b2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:38.013612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c2067ae-6f7c-4551-adda-47829f1d80b2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:38.153447 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c2067ae-6f7c-4551-adda-47829f1d80b2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:38.162558 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c2067ae-6f7c-4551-adda-47829f1d80b2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:38.164038 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c2067ae-6f7c-4551-adda-47829f1d80b2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:38.165215 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6c2067ae-6f7c-4551-adda-47829f1d80b2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.165669 Jun 03 13:16:38.166502 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 418/847] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:37 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:39.187445 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-37225044-f725-475b-af25-50363abcfd6f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:39.188220 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-37225044-f725-475b-af25-50363abcfd6f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:39.197284 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37225044-f725-475b-af25-50363abcfd6f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:39.197948 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37225044-f725-475b-af25-50363abcfd6f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:39.199027 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37225044-f725-475b-af25-50363abcfd6f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:39.199608 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-37225044-f725-475b-af25-50363abcfd6f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:39.341021 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-37225044-f725-475b-af25-50363abcfd6f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:39.349139 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-37225044-f725-475b-af25-50363abcfd6f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:39.350684 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-37225044-f725-475b-af25-50363abcfd6f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:39.351861 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-37225044-f725-475b-af25-50363abcfd6f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.170371 Jun 03 13:16:39.352408 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 430/848] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:39 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:40.375167 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3cc77437-f85a-48af-bda7-9d8e25436d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:40.376340 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3cc77437-f85a-48af-bda7-9d8e25436d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:40.386692 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3cc77437-f85a-48af-bda7-9d8e25436d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:40.387154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3cc77437-f85a-48af-bda7-9d8e25436d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:40.387931 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3cc77437-f85a-48af-bda7-9d8e25436d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:40.388368 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3cc77437-f85a-48af-bda7-9d8e25436d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:40.523450 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3cc77437-f85a-48af-bda7-9d8e25436d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:40.532357 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3cc77437-f85a-48af-bda7-9d8e25436d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:40.533907 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-3cc77437-f85a-48af-bda7-9d8e25436d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:40.535090 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3cc77437-f85a-48af-bda7-9d8e25436d46 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.166840 Jun 03 13:16:40.535862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 419/849] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:40 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:41.443059 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-03e290e2-f38d-4f1b-83a7-8de5280e08ef tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:41.443783 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-03e290e2-f38d-4f1b-83a7-8de5280e08ef tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:41.447297 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-c292b5ad-0525-4a65-aaf5-43f8b03bc0ad req-871652eb-5527-4fa2-9a1c-43f8637a893f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc45db24-e642-4aad-b751-d4d3483e8802", "tag": "a9d4c958-22b3-4655-96a7-ac94b9ef865e"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:16:41.451343 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03e290e2-f38d-4f1b-83a7-8de5280e08ef tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:41.451864 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03e290e2-f38d-4f1b-83a7-8de5280e08ef tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:41.453081 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03e290e2-f38d-4f1b-83a7-8de5280e08ef tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:41.453729 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-03e290e2-f38d-4f1b-83a7-8de5280e08ef tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:41.456112 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-c292b5ad-0525-4a65-aaf5-43f8b03bc0ad req-871652eb-5527-4fa2-9a1c-43f8637a893f service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:41.456601 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-c292b5ad-0525-4a65-aaf5-43f8b03bc0ad req-871652eb-5527-4fa2-9a1c-43f8637a893f service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:41.459308 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:41.470084 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-c292b5ad-0525-4a65-aaf5-43f8b03bc0ad req-871652eb-5527-4fa2-9a1c-43f8637a893f service nova] Creating event network-changed:a9d4c958-22b3-4655-96a7-ac94b9ef865e for instance dc45db24-e642-4aad-b751-d4d3483e8802 on hv-cinder-77954 Jun 03 13:16:41.475543 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-c292b5ad-0525-4a65-aaf5-43f8b03bc0ad req-871652eb-5527-4fa2-9a1c-43f8637a893f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034314 Jun 03 13:16:41.476345 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 420/850] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:16:41.484295 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-03e290e2-f38d-4f1b-83a7-8de5280e08ef tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:16:41.521590 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:41.554966 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5a2f1951-bcfb-477a-91ff-48db8bfc0551 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:41.555853 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5a2f1951-bcfb-477a-91ff-48db8bfc0551 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:41.565272 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a2f1951-bcfb-477a-91ff-48db8bfc0551 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:41.565954 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a2f1951-bcfb-477a-91ff-48db8bfc0551 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:41.567657 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a2f1951-bcfb-477a-91ff-48db8bfc0551 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:41.568091 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a2f1951-bcfb-477a-91ff-48db8bfc0551 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:41.592775 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-03e290e2-f38d-4f1b-83a7-8de5280e08ef tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 204 len: 0 microversion: 2.1 time: 0.154007 Jun 03 13:16:41.593747 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 431/851] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:16:41 2022] DELETE /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:16:41.606777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ef0893e1-bbb2-4766-bd7f-55a03ca2e487 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:41.607526 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ef0893e1-bbb2-4766-bd7f-55a03ca2e487 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:41.614947 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef0893e1-bbb2-4766-bd7f-55a03ca2e487 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:41.615130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef0893e1-bbb2-4766-bd7f-55a03ca2e487 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:41.615806 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef0893e1-bbb2-4766-bd7f-55a03ca2e487 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:41.616248 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef0893e1-bbb2-4766-bd7f-55a03ca2e487 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:41.794740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5a2f1951-bcfb-477a-91ff-48db8bfc0551 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:41.804211 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5a2f1951-bcfb-477a-91ff-48db8bfc0551 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:41.806098 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5a2f1951-bcfb-477a-91ff-48db8bfc0551 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:41.808027 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5a2f1951-bcfb-477a-91ff-48db8bfc0551 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.258253 Jun 03 13:16:41.811834 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ef0893e1-bbb2-4766-bd7f-55a03ca2e487 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:41.819034 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 421/852] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:41 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:41.820821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ef0893e1-bbb2-4766-bd7f-55a03ca2e487 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1578 microversion: 2.1 time: 0.222663 Jun 03 13:16:41.821683 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 432/853] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:16:41 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1578 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:16:41.892878 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-48deffa9-41a5-4823-a674-b690a1e60703 req-3f38cfa1-0555-4df1-9e4e-d653b782231a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d2637b-e308-49ad-a633-946086696188", "name": "network-vif-plugged", "status": "completed", "tag": "b413ac88-a552-4af1-9a97-aa251a314588"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:16:41.901337 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-48deffa9-41a5-4823-a674-b690a1e60703 req-3f38cfa1-0555-4df1-9e4e-d653b782231a service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:41.901780 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-48deffa9-41a5-4823-a674-b690a1e60703 req-3f38cfa1-0555-4df1-9e4e-d653b782231a service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:41.913155 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-48deffa9-41a5-4823-a674-b690a1e60703 req-3f38cfa1-0555-4df1-9e4e-d653b782231a service nova] Creating event network-vif-plugged:b413ac88-a552-4af1-9a97-aa251a314588 for instance b7d2637b-e308-49ad-a633-946086696188 on hv-cinder-77954 Jun 03 13:16:41.918724 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-48deffa9-41a5-4823-a674-b690a1e60703 req-3f38cfa1-0555-4df1-9e4e-d653b782231a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029520 Jun 03 13:16:41.919335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 422/854] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:16:42.119152 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:16:42.119152 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Fri Jun 3 13:16:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:16:42.825439 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-86ee3552-c7ee-4ce5-a29f-3a56b651d20d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:42.826195 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-86ee3552-c7ee-4ce5-a29f-3a56b651d20d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:42.833066 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86ee3552-c7ee-4ce5-a29f-3a56b651d20d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:42.833898 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86ee3552-c7ee-4ce5-a29f-3a56b651d20d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:42.834758 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86ee3552-c7ee-4ce5-a29f-3a56b651d20d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:42.835418 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-86ee3552-c7ee-4ce5-a29f-3a56b651d20d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:42.840179 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-fc35fbd6-9fda-42e5-87c6-c206953e8da0 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:42.840891 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-fc35fbd6-9fda-42e5-87c6-c206953e8da0 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:42.851780 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc35fbd6-9fda-42e5-87c6-c206953e8da0 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:42.852547 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc35fbd6-9fda-42e5-87c6-c206953e8da0 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:42.853550 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc35fbd6-9fda-42e5-87c6-c206953e8da0 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:42.854365 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-fc35fbd6-9fda-42e5-87c6-c206953e8da0 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:43.048518 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-86ee3552-c7ee-4ce5-a29f-3a56b651d20d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:43.052741 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-fc35fbd6-9fda-42e5-87c6-c206953e8da0 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:43.056993 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-86ee3552-c7ee-4ce5-a29f-3a56b651d20d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:43.058645 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-86ee3552-c7ee-4ce5-a29f-3a56b651d20d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:43.060184 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-86ee3552-c7ee-4ce5-a29f-3a56b651d20d tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.238425 Jun 03 13:16:43.060396 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 433/855] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:42 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:43.061427 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-fc35fbd6-9fda-42e5-87c6-c206953e8da0 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1578 microversion: 2.1 time: 0.226321 Jun 03 13:16:43.071048 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 423/856] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:16:42 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1578 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:16:44.078596 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f7c9a35f-5fad-43bc-8f4c-8d07cb25e6de tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:44.079084 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-284adeb8-b7c5-4f22-84ed-fc68fd974a70 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:44.079446 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f7c9a35f-5fad-43bc-8f4c-8d07cb25e6de tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:44.080035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-284adeb8-b7c5-4f22-84ed-fc68fd974a70 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:44.086005 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f7c9a35f-5fad-43bc-8f4c-8d07cb25e6de tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:44.086485 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f7c9a35f-5fad-43bc-8f4c-8d07cb25e6de tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:44.086601 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-284adeb8-b7c5-4f22-84ed-fc68fd974a70 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:44.087035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-284adeb8-b7c5-4f22-84ed-fc68fd974a70 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:44.087253 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f7c9a35f-5fad-43bc-8f4c-8d07cb25e6de tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:44.087769 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f7c9a35f-5fad-43bc-8f4c-8d07cb25e6de tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:44.087961 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-284adeb8-b7c5-4f22-84ed-fc68fd974a70 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:44.088273 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-284adeb8-b7c5-4f22-84ed-fc68fd974a70 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:44.186594 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-284adeb8-b7c5-4f22-84ed-fc68fd974a70 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:44.194630 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-284adeb8-b7c5-4f22-84ed-fc68fd974a70 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 200 len: 1392 microversion: 2.1 time: 0.119641 Jun 03 13:16:44.195213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 424/857] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:16:44 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 1392 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:16:44.200101 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-5e595a71-88e7-4971-9e95-94910f754acf req-fe0b1bb4-52cb-4c95-9912-2f56c42c6b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc45db24-e642-4aad-b751-d4d3483e8802", "name": "network-vif-deleted", "tag": "a9d4c958-22b3-4655-96a7-ac94b9ef865e"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:16:44.208185 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-5e595a71-88e7-4971-9e95-94910f754acf req-fe0b1bb4-52cb-4c95-9912-2f56c42c6b96 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:44.208616 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-5e595a71-88e7-4971-9e95-94910f754acf req-fe0b1bb4-52cb-4c95-9912-2f56c42c6b96 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:44.219839 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-5e595a71-88e7-4971-9e95-94910f754acf req-fe0b1bb4-52cb-4c95-9912-2f56c42c6b96 service nova] Creating event network-vif-deleted:a9d4c958-22b3-4655-96a7-ac94b9ef865e for instance dc45db24-e642-4aad-b751-d4d3483e8802 on hv-cinder-77954 Jun 03 13:16:44.224871 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-5e595a71-88e7-4971-9e95-94910f754acf req-fe0b1bb4-52cb-4c95-9912-2f56c42c6b96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028584 Jun 03 13:16:44.225552 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 425/858] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:16:44.255410 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f7c9a35f-5fad-43bc-8f4c-8d07cb25e6de tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:44.264321 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f7c9a35f-5fad-43bc-8f4c-8d07cb25e6de tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:44.265829 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f7c9a35f-5fad-43bc-8f4c-8d07cb25e6de tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:44.267023 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f7c9a35f-5fad-43bc-8f4c-8d07cb25e6de tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.192764 Jun 03 13:16:44.267583 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 434/859] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:44 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:45.214381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e59e8da9-f21e-4eb8-9eb7-9bec45abc158 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:45.215066 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e59e8da9-f21e-4eb8-9eb7-9bec45abc158 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: dc45db24-e642-4aad-b751-d4d3483e8802] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:45.221692 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e59e8da9-f21e-4eb8-9eb7-9bec45abc158 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:45.222414 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e59e8da9-f21e-4eb8-9eb7-9bec45abc158 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:45.223439 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e59e8da9-f21e-4eb8-9eb7-9bec45abc158 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:45.223846 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e59e8da9-f21e-4eb8-9eb7-9bec45abc158 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:45.241065 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-e59e8da9-f21e-4eb8-9eb7-9bec45abc158 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] HTTP exception thrown: Instance dc45db24-e642-4aad-b751-d4d3483e8802 could not be found. Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e59e8da9-f21e-4eb8-9eb7-9bec45abc158 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Request method failure captured: Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 HTTP/1.1 Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgfeytFCBbTmb-nz0uvAugFHpDwiFmPgvH_bG5Vy_Ec3SvGI2rOcvMxSoI2S-HBNeAyqE38UVPxXlG8sHf0HI9aWoGAzNP5fTq-U_PNGiatpW79wFlOFg2LOlPMWCvQqv1olELFZPDbJ2A_WiDzfMFgAPlCNn3_wxICqPgugH7zGX58 Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 2fd9de1783e54cafadd25ecc97876288 Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-TestVolumeBootPattern-537336768 Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:16:45.242805 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:16:45.244334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd9de1783e54cafadd25ecc97876288"}]}] Jun 03 13:16:45.244334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-TestVolumeBootPattern-537336768 Jun 03 13:16:45.244334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 2fd9de1783e54cafadd25ecc97876288 Jun 03 13:16:45.244334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-TestVolumeBootPattern-537336768 Jun 03 13:16:45.244334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-TestVolumeBootPattern-537336768-project Jun 03 13:16:45.244334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:16:45.244334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:16:45.244334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 62f5e92899b84d5594a34643b662d233 Jun 03 13:16:45.244334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-TestVolumeBootPattern-537336768-project Jun 03 13:16:45.244334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:16:45.244334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance dc45db24-e642-4aad-b751-d4d3483e8802 could not be found. Jun 03 13:16:45.244334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': 'dc45db24-e642-4aad-b751-d4d3483e8802'} Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc45db24-e642-4aad-b751-d4d3483e8802 could not be found. Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:16:45.245135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc45db24-e642-4aad-b751-d4d3483e8802 could not be found. Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc45db24-e642-4aad-b751-d4d3483e8802 could not be found. Jun 03 13:16:45.246569 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:45.247772 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e59e8da9-f21e-4eb8-9eb7-9bec45abc158 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Returning 404 to user: Instance dc45db24-e642-4aad-b751-d4d3483e8802 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:16:45.247772 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e59e8da9-f21e-4eb8-9eb7-9bec45abc158 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802" status: 404 len: 111 microversion: 2.1 time: 0.034900 Jun 03 13:16:45.247772 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 426/860] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:16:45 2022] GET /compute/v2.1/servers/dc45db24-e642-4aad-b751-d4d3483e8802 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:16:45.285262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e02cae43-76f1-47b2-a0f1-a189958f7a7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:45.286202 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e02cae43-76f1-47b2-a0f1-a189958f7a7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:45.294292 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e02cae43-76f1-47b2-a0f1-a189958f7a7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:45.295302 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e02cae43-76f1-47b2-a0f1-a189958f7a7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:45.297193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e02cae43-76f1-47b2-a0f1-a189958f7a7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:45.297656 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e02cae43-76f1-47b2-a0f1-a189958f7a7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:45.439665 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e02cae43-76f1-47b2-a0f1-a189958f7a7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:45.449091 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e02cae43-76f1-47b2-a0f1-a189958f7a7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:45.450644 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e02cae43-76f1-47b2-a0f1-a189958f7a7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:45.452087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e02cae43-76f1-47b2-a0f1-a189958f7a7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1729 microversion: 2.20 time: 0.170964 Jun 03 13:16:45.452778 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 435/861] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:45 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:46.470682 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4d2762e5-62fc-4105-b925-8746c04dbb9b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:46.471297 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4d2762e5-62fc-4105-b925-8746c04dbb9b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:46.473770 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=42 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:46.479381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d2762e5-62fc-4105-b925-8746c04dbb9b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:46.479830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d2762e5-62fc-4105-b925-8746c04dbb9b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:46.480616 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d2762e5-62fc-4105-b925-8746c04dbb9b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:46.481046 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4d2762e5-62fc-4105-b925-8746c04dbb9b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:46.628187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4d2762e5-62fc-4105-b925-8746c04dbb9b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:46.636516 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4d2762e5-62fc-4105-b925-8746c04dbb9b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:46.638022 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4d2762e5-62fc-4105-b925-8746c04dbb9b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:46.639224 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4d2762e5-62fc-4105-b925-8746c04dbb9b tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1716 microversion: 2.20 time: 0.172609 Jun 03 13:16:46.639787 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 427/862] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:16:46 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1716 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:16:48.387950 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-80d9d64a-ed74-48ec-84ef-ad1a00db6a81 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:48.388490 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-80d9d64a-ed74-48ec-84ef-ad1a00db6a81 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:48.391074 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:16:48.395790 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-2bc6bb92-fd12-43f6-98fe-b22aba9e3a95 req-e2783490-21b0-4ba3-ba93-4be27d762b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4366f6f4-c8c3-4f29-af5e-94a09d9043d2", "tag": "4d7fd1c2-1a76-429a-9e14-45cde7f9a713"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:16:48.397605 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80d9d64a-ed74-48ec-84ef-ad1a00db6a81 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:48.398019 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80d9d64a-ed74-48ec-84ef-ad1a00db6a81 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:48.398843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80d9d64a-ed74-48ec-84ef-ad1a00db6a81 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:48.399397 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80d9d64a-ed74-48ec-84ef-ad1a00db6a81 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:48.404936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-2bc6bb92-fd12-43f6-98fe-b22aba9e3a95 req-e2783490-21b0-4ba3-ba93-4be27d762b7e service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:48.405474 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-2bc6bb92-fd12-43f6-98fe-b22aba9e3a95 req-e2783490-21b0-4ba3-ba93-4be27d762b7e service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:48.417001 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-2bc6bb92-fd12-43f6-98fe-b22aba9e3a95 req-e2783490-21b0-4ba3-ba93-4be27d762b7e service nova] Creating event network-changed:4d7fd1c2-1a76-429a-9e14-45cde7f9a713 for instance 4366f6f4-c8c3-4f29-af5e-94a09d9043d2 on hv-cinder-77954 Jun 03 13:16:48.422067 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-2bc6bb92-fd12-43f6-98fe-b22aba9e3a95 req-e2783490-21b0-4ba3-ba93-4be27d762b7e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030648 Jun 03 13:16:48.422710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 428/863] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:16:48.427194 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-80d9d64a-ed74-48ec-84ef-ad1a00db6a81 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:16:48.515257 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-80d9d64a-ed74-48ec-84ef-ad1a00db6a81 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 204 len: 0 microversion: 2.1 time: 0.131169 Jun 03 13:16:48.516276 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 436/864] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:16:48 2022] DELETE /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:16:48.525647 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ce99fb01-c15d-4f18-94c2-490f9cf170ac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:48.526625 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ce99fb01-c15d-4f18-94c2-490f9cf170ac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:48.542374 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ce99fb01-c15d-4f18-94c2-490f9cf170ac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:48.542374 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ce99fb01-c15d-4f18-94c2-490f9cf170ac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:48.542374 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ce99fb01-c15d-4f18-94c2-490f9cf170ac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:48.542374 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ce99fb01-c15d-4f18-94c2-490f9cf170ac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:48.686469 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ce99fb01-c15d-4f18-94c2-490f9cf170ac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:48.696480 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ce99fb01-c15d-4f18-94c2-490f9cf170ac tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1577 microversion: 2.1 time: 0.175689 Jun 03 13:16:48.706493 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 429/865] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:16:48 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:16:49.715031 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-77548fdb-456c-4161-b11e-9d585f9d80ad tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:49.715741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-77548fdb-456c-4161-b11e-9d585f9d80ad tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:49.722233 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77548fdb-456c-4161-b11e-9d585f9d80ad tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:49.722694 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77548fdb-456c-4161-b11e-9d585f9d80ad tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:49.723480 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77548fdb-456c-4161-b11e-9d585f9d80ad tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:49.723896 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-77548fdb-456c-4161-b11e-9d585f9d80ad tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:49.861284 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-77548fdb-456c-4161-b11e-9d585f9d80ad tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:49.869543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-77548fdb-456c-4161-b11e-9d585f9d80ad tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1577 microversion: 2.1 time: 0.159042 Jun 03 13:16:49.878998 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 437/866] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:16:49 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:16:50.596883 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-35716b55-7825-4b9b-95c4-24ea8e292879 req-1466caae-53bf-41e0-b910-4b1202021d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4366f6f4-c8c3-4f29-af5e-94a09d9043d2", "name": "network-vif-deleted", "tag": "4d7fd1c2-1a76-429a-9e14-45cde7f9a713"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:16:50.606873 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-35716b55-7825-4b9b-95c4-24ea8e292879 req-1466caae-53bf-41e0-b910-4b1202021d8f service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:50.607273 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-35716b55-7825-4b9b-95c4-24ea8e292879 req-1466caae-53bf-41e0-b910-4b1202021d8f service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:50.620047 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-35716b55-7825-4b9b-95c4-24ea8e292879 req-1466caae-53bf-41e0-b910-4b1202021d8f service nova] Creating event network-vif-deleted:4d7fd1c2-1a76-429a-9e14-45cde7f9a713 for instance 4366f6f4-c8c3-4f29-af5e-94a09d9043d2 on hv-cinder-77954 Jun 03 13:16:50.625607 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-35716b55-7825-4b9b-95c4-24ea8e292879 req-1466caae-53bf-41e0-b910-4b1202021d8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032618 Jun 03 13:16:50.626590 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 430/867] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:16:50.886462 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-54aa8c1b-cdaf-46cf-a490-16142f5a0d2a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:50.887106 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-54aa8c1b-cdaf-46cf-a490-16142f5a0d2a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:50.895550 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54aa8c1b-cdaf-46cf-a490-16142f5a0d2a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:50.896334 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54aa8c1b-cdaf-46cf-a490-16142f5a0d2a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:50.897141 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54aa8c1b-cdaf-46cf-a490-16142f5a0d2a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:50.897582 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54aa8c1b-cdaf-46cf-a490-16142f5a0d2a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:50.930642 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54aa8c1b-cdaf-46cf-a490-16142f5a0d2a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:50.931092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-54aa8c1b-cdaf-46cf-a490-16142f5a0d2a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:50.931656 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-54aa8c1b-cdaf-46cf-a490-16142f5a0d2a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lazy-loading 'fault' on Instance uuid 4366f6f4-c8c3-4f29-af5e-94a09d9043d2 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:16:50.974806 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-54aa8c1b-cdaf-46cf-a490-16142f5a0d2a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f5e92899b84d5594a34643b662d233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fd9de1783e54cafadd25ecc97876288', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:16:50.982909 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-54aa8c1b-cdaf-46cf-a490-16142f5a0d2a tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 200 len: 1230 microversion: 2.1 time: 0.100657 Jun 03 13:16:50.993186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 438/868] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:16:50 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:16:52.006680 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c39bf351-4dda-49fb-9b49-07f4fe9c30b8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:52.007853 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c39bf351-4dda-49fb-9b49-07f4fe9c30b8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: 4366f6f4-c8c3-4f29-af5e-94a09d9043d2] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:52.018662 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c39bf351-4dda-49fb-9b49-07f4fe9c30b8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:52.019186 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c39bf351-4dda-49fb-9b49-07f4fe9c30b8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:52.019977 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c39bf351-4dda-49fb-9b49-07f4fe9c30b8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:52.020420 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c39bf351-4dda-49fb-9b49-07f4fe9c30b8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:52.034208 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-c39bf351-4dda-49fb-9b49-07f4fe9c30b8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] HTTP exception thrown: Instance 4366f6f4-c8c3-4f29-af5e-94a09d9043d2 could not be found. Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c39bf351-4dda-49fb-9b49-07f4fe9c30b8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Request method failure captured: Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 HTTP/1.1 Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgfeytFCBbTmb-nz0uvAugFHpDwiFmPgvH_bG5Vy_Ec3SvGI2rOcvMxSoI2S-HBNeAyqE38UVPxXlG8sHf0HI9aWoGAzNP5fTq-U_PNGiatpW79wFlOFg2LOlPMWCvQqv1olELFZPDbJ2A_WiDzfMFgAPlCNn3_wxICqPgugH7zGX58 Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 2fd9de1783e54cafadd25ecc97876288 Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-TestVolumeBootPattern-537336768 Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:16:52.035836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:16:52.037371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd9de1783e54cafadd25ecc97876288"}]}] Jun 03 13:16:52.037371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-TestVolumeBootPattern-537336768 Jun 03 13:16:52.037371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 2fd9de1783e54cafadd25ecc97876288 Jun 03 13:16:52.037371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-TestVolumeBootPattern-537336768 Jun 03 13:16:52.037371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-TestVolumeBootPattern-537336768-project Jun 03 13:16:52.037371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:16:52.037371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:16:52.037371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 62f5e92899b84d5594a34643b662d233 Jun 03 13:16:52.037371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-TestVolumeBootPattern-537336768-project Jun 03 13:16:52.037371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:16:52.037371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 4366f6f4-c8c3-4f29-af5e-94a09d9043d2 could not be found. Jun 03 13:16:52.037371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '4366f6f4-c8c3-4f29-af5e-94a09d9043d2'} Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4366f6f4-c8c3-4f29-af5e-94a09d9043d2 could not be found. Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:16:52.038321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4366f6f4-c8c3-4f29-af5e-94a09d9043d2 could not be found. Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4366f6f4-c8c3-4f29-af5e-94a09d9043d2 could not be found. Jun 03 13:16:52.039712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.041344 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c39bf351-4dda-49fb-9b49-07f4fe9c30b8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Returning 404 to user: Instance 4366f6f4-c8c3-4f29-af5e-94a09d9043d2 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:16:52.041344 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c39bf351-4dda-49fb-9b49-07f4fe9c30b8 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2" status: 404 len: 111 microversion: 2.1 time: 0.038535 Jun 03 13:16:52.041344 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 431/869] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:16:51 2022] GET /compute/v2.1/servers/4366f6f4-c8c3-4f29-af5e-94a09d9043d2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:16:52.528222 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-12f70cbb-5f20-4c9e-80ea-d4c79aa64220 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:52.528782 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-12f70cbb-5f20-4c9e-80ea-d4c79aa64220 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:52.535710 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12f70cbb-5f20-4c9e-80ea-d4c79aa64220 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:52.536157 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12f70cbb-5f20-4c9e-80ea-d4c79aa64220 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:52.536933 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12f70cbb-5f20-4c9e-80ea-d4c79aa64220 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:52.537364 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-12f70cbb-5f20-4c9e-80ea-d4c79aa64220 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:52.553883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-12f70cbb-5f20-4c9e-80ea-d4c79aa64220 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] HTTP exception thrown: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-12f70cbb-5f20-4c9e-80ea-d4c79aa64220 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Request method failure captured: Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b HTTP/1.1 Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgfeytFCBbTmb-nz0uvAugFHpDwiFmPgvH_bG5Vy_Ec3SvGI2rOcvMxSoI2S-HBNeAyqE38UVPxXlG8sHf0HI9aWoGAzNP5fTq-U_PNGiatpW79wFlOFg2LOlPMWCvQqv1olELFZPDbJ2A_WiDzfMFgAPlCNn3_wxICqPgugH7zGX58 Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 2fd9de1783e54cafadd25ecc97876288 Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-TestVolumeBootPattern-537336768 Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:16:52.555602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:16:52.557433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd9de1783e54cafadd25ecc97876288"}]}] Jun 03 13:16:52.557433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-TestVolumeBootPattern-537336768 Jun 03 13:16:52.557433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 2fd9de1783e54cafadd25ecc97876288 Jun 03 13:16:52.557433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-TestVolumeBootPattern-537336768 Jun 03 13:16:52.557433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-TestVolumeBootPattern-537336768-project Jun 03 13:16:52.557433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:16:52.557433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:16:52.557433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 62f5e92899b84d5594a34643b662d233 Jun 03 13:16:52.557433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-TestVolumeBootPattern-537336768-project Jun 03 13:16:52.557433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:16:52.557433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:16:52.557433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': 'cba60da9-2b35-486d-94f0-3d134c9fdf3b'} Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:16:52.561599 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:16:52.563092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.564756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-12f70cbb-5f20-4c9e-80ea-d4c79aa64220 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Returning 404 to user: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:16:52.564756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-12f70cbb-5f20-4c9e-80ea-d4c79aa64220 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 404 len: 111 microversion: 2.1 time: 0.033626 Jun 03 13:16:52.564756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 439/870] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:16:52 2022] DELETE /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:16:52.566410 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ae19d78c-fa2d-43d6-ad48-c4634e41a16c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:52.567028 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ae19d78c-fa2d-43d6-ad48-c4634e41a16c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] [instance: cba60da9-2b35-486d-94f0-3d134c9fdf3b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:16:52.573825 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae19d78c-fa2d-43d6-ad48-c4634e41a16c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:52.574306 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae19d78c-fa2d-43d6-ad48-c4634e41a16c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:52.575071 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae19d78c-fa2d-43d6-ad48-c4634e41a16c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:16:52.575505 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ae19d78c-fa2d-43d6-ad48-c4634e41a16c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:16:52.589379 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-ae19d78c-fa2d-43d6-ad48-c4634e41a16c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] HTTP exception thrown: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ae19d78c-fa2d-43d6-ad48-c4634e41a16c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Request method failure captured: Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b HTTP/1.1 Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgfeytFCBbTmb-nz0uvAugFHpDwiFmPgvH_bG5Vy_Ec3SvGI2rOcvMxSoI2S-HBNeAyqE38UVPxXlG8sHf0HI9aWoGAzNP5fTq-U_PNGiatpW79wFlOFg2LOlPMWCvQqv1olELFZPDbJ2A_WiDzfMFgAPlCNn3_wxICqPgugH7zGX58 Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 2fd9de1783e54cafadd25ecc97876288 Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-TestVolumeBootPattern-537336768 Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:16:52.590909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:16:52.592488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2fd9de1783e54cafadd25ecc97876288"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2fd9de1783e54cafadd25ecc97876288"}]}] Jun 03 13:16:52.592488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-TestVolumeBootPattern-537336768 Jun 03 13:16:52.592488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 2fd9de1783e54cafadd25ecc97876288 Jun 03 13:16:52.592488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-TestVolumeBootPattern-537336768 Jun 03 13:16:52.592488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-TestVolumeBootPattern-537336768-project Jun 03 13:16:52.592488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:16:52.592488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:16:52.592488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 62f5e92899b84d5594a34643b662d233 Jun 03 13:16:52.592488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-TestVolumeBootPattern-537336768-project Jun 03 13:16:52.592488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:16:52.592488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:16:52.592488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': 'cba60da9-2b35-486d-94f0-3d134c9fdf3b'} Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:16:52.593396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. Jun 03 13:16:52.595013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:16:52.596605 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ae19d78c-fa2d-43d6-ad48-c4634e41a16c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Returning 404 to user: Instance cba60da9-2b35-486d-94f0-3d134c9fdf3b could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:16:52.596605 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ae19d78c-fa2d-43d6-ad48-c4634e41a16c tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b" status: 404 len: 111 microversion: 2.1 time: 0.029966 Jun 03 13:16:52.596605 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 432/871] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:16:52 2022] GET /compute/v2.1/servers/cba60da9-2b35-486d-94f0-3d134c9fdf3b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:16:53.914926 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a977212b-733f-4b03-a514-1ff8f6f69873 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] Calling method '.version_select at 0x7fc5a9569ca0>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:16:53.936700 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a977212b-733f-4b03-a514-1ff8f6f69873 tempest-TestVolumeBootPattern-537336768 tempest-TestVolumeBootPattern-537336768-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2140023348" status: 202 len: 0 microversion: 2.1 time: 0.025521 Jun 03 13:16:53.937383 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 440/872] 10.222.0.58 () {58 vars in 1262 bytes} [Fri Jun 3 13:16:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2140023348 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:17:19.950009 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:17:19.951372 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Fri Jun 3 13:17:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:17:42.011350 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-72e4c3b0-b017-4b8f-81b9-6ef6c7c96cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:17:42.012491 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-72e4c3b0-b017-4b8f-81b9-6ef6c7c96cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:17:42.015803 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=11 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:42.016461 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=45 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:42.024325 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72e4c3b0-b017-4b8f-81b9-6ef6c7c96cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:42.024936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72e4c3b0-b017-4b8f-81b9-6ef6c7c96cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:42.026150 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72e4c3b0-b017-4b8f-81b9-6ef6c7c96cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:42.026829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-72e4c3b0-b017-4b8f-81b9-6ef6c7c96cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:42.057745 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-72e4c3b0-b017-4b8f-81b9-6ef6c7c96cd2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053118 Jun 03 13:17:42.058327 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 433/873] 10.222.0.58 () {60 vars in 1342 bytes} [Fri Jun 3 13:17:42 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:17:42.122282 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:42.123158 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:42.297076 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-33b0c38d-afa7-4477-85d7-a0436319ee04 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:17:42.298157 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-33b0c38d-afa7-4477-85d7-a0436319ee04 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:17:42.305377 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33b0c38d-afa7-4477-85d7-a0436319ee04 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:42.305875 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33b0c38d-afa7-4477-85d7-a0436319ee04 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:42.306741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33b0c38d-afa7-4477-85d7-a0436319ee04 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:42.307153 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-33b0c38d-afa7-4477-85d7-a0436319ee04 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:42.339143 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-33b0c38d-afa7-4477-85d7-a0436319ee04 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:17:42.426397 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-33b0c38d-afa7-4477-85d7-a0436319ee04 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 204 len: 0 microversion: 2.20 time: 0.306311 Jun 03 13:17:42.426986 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 441/874] 10.222.0.58 () {60 vars in 1279 bytes} [Fri Jun 3 13:17:42 2022] DELETE /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 13:17:42.435418 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d7d76bc8-ac21-40a8-b658-afe6ff97df78 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:17:42.436060 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d7d76bc8-ac21-40a8-b658-afe6ff97df78 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:17:42.443114 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7d76bc8-ac21-40a8-b658-afe6ff97df78 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:42.443567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7d76bc8-ac21-40a8-b658-afe6ff97df78 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:42.444348 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7d76bc8-ac21-40a8-b658-afe6ff97df78 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:42.444784 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d7d76bc8-ac21-40a8-b658-afe6ff97df78 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:42.854662 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d7d76bc8-ac21-40a8-b658-afe6ff97df78 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:17:42.863486 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d7d76bc8-ac21-40a8-b658-afe6ff97df78 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:17:42.864994 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d7d76bc8-ac21-40a8-b658-afe6ff97df78 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:17:42.866175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d7d76bc8-ac21-40a8-b658-afe6ff97df78 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.434724 Jun 03 13:17:42.866767 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 434/875] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:17:42 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:17:43.890028 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9c8c736d-0494-4bbc-b055-f594112a0acd tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:17:43.891111 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9c8c736d-0494-4bbc-b055-f594112a0acd tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:17:43.898902 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9c8c736d-0494-4bbc-b055-f594112a0acd tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:43.899326 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9c8c736d-0494-4bbc-b055-f594112a0acd tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:43.900123 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9c8c736d-0494-4bbc-b055-f594112a0acd tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:43.900552 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9c8c736d-0494-4bbc-b055-f594112a0acd tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:44.098475 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9c8c736d-0494-4bbc-b055-f594112a0acd tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:17:44.106628 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9c8c736d-0494-4bbc-b055-f594112a0acd tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:17:44.108143 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9c8c736d-0494-4bbc-b055-f594112a0acd tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:17:44.109321 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9c8c736d-0494-4bbc-b055-f594112a0acd tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1722 microversion: 2.20 time: 0.226743 Jun 03 13:17:44.109964 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 442/876] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:17:43 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:17:44.754546 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-413ec743-5936-4e02-bb0c-d500ea7f4a8c req-44d78939-54be-40a7-8294-a2168dcad69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7d2637b-e308-49ad-a633-946086696188", "name": "network-vif-deleted", "tag": "b413ac88-a552-4af1-9a97-aa251a314588"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:17:44.763616 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-413ec743-5936-4e02-bb0c-d500ea7f4a8c req-44d78939-54be-40a7-8294-a2168dcad69b service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:44.764629 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-413ec743-5936-4e02-bb0c-d500ea7f4a8c req-44d78939-54be-40a7-8294-a2168dcad69b service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:44.777918 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-413ec743-5936-4e02-bb0c-d500ea7f4a8c req-44d78939-54be-40a7-8294-a2168dcad69b service nova] Creating event network-vif-deleted:b413ac88-a552-4af1-9a97-aa251a314588 for instance b7d2637b-e308-49ad-a633-946086696188 on hv-cinder-77954 Jun 03 13:17:44.783327 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-413ec743-5936-4e02-bb0c-d500ea7f4a8c req-44d78939-54be-40a7-8294-a2168dcad69b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032827 Jun 03 13:17:44.784323 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 435/877] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:17:45.128326 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:17:45.128925 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:17:45.136173 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:45.136628 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:45.137404 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:45.137811 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:45.171396 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:45.171914 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:45.172373 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lazy-loading 'fault' on Instance uuid b7d2637b-e308-49ad-a633-946086696188 {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:17:45.216387 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:17:45.226237 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:17:45.227728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '49b596abb9a5466595eec1a8fb25d5a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020ed9813c614d2eae9568ba85728136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:17:45.229121 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5a775ba8-43f4-4e07-bee1-e0a5237f3c7f tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 200 len: 1370 microversion: 2.20 time: 0.105688 Jun 03 13:17:45.240863 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 443/878] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:17:45 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 1370 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 13:17:46.253558 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3325cb20-a0b3-48ec-ad17-3b3dea7a8367 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:17:46.254286 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3325cb20-a0b3-48ec-ad17-3b3dea7a8367 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:17:46.261142 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3325cb20-a0b3-48ec-ad17-3b3dea7a8367 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:46.261599 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3325cb20-a0b3-48ec-ad17-3b3dea7a8367 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:46.262406 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3325cb20-a0b3-48ec-ad17-3b3dea7a8367 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:46.262846 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3325cb20-a0b3-48ec-ad17-3b3dea7a8367 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:46.277653 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-3325cb20-a0b3-48ec-ad17-3b3dea7a8367 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] HTTP exception thrown: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3325cb20-a0b3-48ec-ad17-3b3dea7a8367 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Request method failure captured: Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 HTTP/1.1 Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimggsCu1QqC4sdBq_S3SgbeYiDpuNEHjM4Y87AKRUvxbU1aziVyBQldQOcYxH0V14gqDyyCm56eWgfn0N0mQx5EI9Rmc1M0Pk79Ij3qSH5ZhZ7uH7w37JulL1vhPJWdq2uKDhjMmDzBGdWFszMCxST2aUlnMdQpfs0u8vHW0W4X6moII Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 020ed9813c614d2eae9568ba85728136 Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:17:46.279322 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:17:46.280997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/020ed9813c614d2eae9568ba85728136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_020ed9813c614d2eae9568ba85728136"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/020ed9813c614d2eae9568ba85728136"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/020ed9813c614d2eae9568ba85728136"}]}] Jun 03 13:17:46.280997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:46.280997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 020ed9813c614d2eae9568ba85728136 Jun 03 13:17:46.280997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:46.280997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeShelveTestJSON-1022356808-project Jun 03 13:17:46.280997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:17:46.280997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:17:46.280997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 49b596abb9a5466595eec1a8fb25d5a1 Jun 03 13:17:46.280997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1022356808-project Jun 03 13:17:46.280997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:17:46.280997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:46.280997 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': 'b7d2637b-e308-49ad-a633-946086696188'} Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:17:46.281829 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:46.283334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:46.284777 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3325cb20-a0b3-48ec-ad17-3b3dea7a8367 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Returning 404 to user: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:17:46.284777 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3325cb20-a0b3-48ec-ad17-3b3dea7a8367 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 404 len: 111 microversion: 2.20 time: 0.034644 Jun 03 13:17:46.284777 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 436/879] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:17:46 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:17:46.289856 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-66c41cd9-cf65-4beb-9fbd-33a333da3598 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '.version_select at 0x7fc5a431e700>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:17:46.311419 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-66c41cd9-cf65-4beb-9fbd-33a333da3598 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-955934959" status: 204 len: 0 microversion: 2.20 time: 0.025444 Jun 03 13:17:46.311986 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 444/880] 10.222.0.58 () {60 vars in 1258 bytes} [Fri Jun 3 13:17:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-955934959 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 13:17:48.100213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b0a2040a-aad7-41af-9856-0fe636c2ff86 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:17:48.100712 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b0a2040a-aad7-41af-9856-0fe636c2ff86 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:17:48.107494 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b0a2040a-aad7-41af-9856-0fe636c2ff86 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:48.107945 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b0a2040a-aad7-41af-9856-0fe636c2ff86 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:48.108718 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b0a2040a-aad7-41af-9856-0fe636c2ff86 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:48.109155 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b0a2040a-aad7-41af-9856-0fe636c2ff86 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:48.123385 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-b0a2040a-aad7-41af-9856-0fe636c2ff86 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] HTTP exception thrown: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b0a2040a-aad7-41af-9856-0fe636c2ff86 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Request method failure captured: Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: DELETE /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 HTTP/1.1 Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimggsCu1QqC4sdBq_S3SgbeYiDpuNEHjM4Y87AKRUvxbU1aziVyBQldQOcYxH0V14gqDyyCm56eWgfn0N0mQx5EI9Rmc1M0Pk79Ij3qSH5ZhZ7uH7w37JulL1vhPJWdq2uKDhjMmDzBGdWFszMCxST2aUlnMdQpfs0u8vHW0W4X6moII Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 020ed9813c614d2eae9568ba85728136 Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:17:48.124937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:17:48.126686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/020ed9813c614d2eae9568ba85728136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_020ed9813c614d2eae9568ba85728136"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/020ed9813c614d2eae9568ba85728136"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/020ed9813c614d2eae9568ba85728136"}]}] Jun 03 13:17:48.126686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:48.126686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 020ed9813c614d2eae9568ba85728136 Jun 03 13:17:48.126686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:48.126686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeShelveTestJSON-1022356808-project Jun 03 13:17:48.126686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:17:48.126686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:17:48.126686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 49b596abb9a5466595eec1a8fb25d5a1 Jun 03 13:17:48.126686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1022356808-project Jun 03 13:17:48.126686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:17:48.126686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:48.126686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': 'b7d2637b-e308-49ad-a633-946086696188'} Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:17:48.127479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:48.128999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:48.130766 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b0a2040a-aad7-41af-9856-0fe636c2ff86 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Returning 404 to user: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:17:48.130766 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b0a2040a-aad7-41af-9856-0fe636c2ff86 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 404 len: 111 microversion: 2.20 time: 0.030127 Jun 03 13:17:48.130766 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 437/881] 10.222.0.58 () {60 vars in 1279 bytes} [Fri Jun 3 13:17:48 2022] DELETE /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:17:48.138051 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-19ffaa4e-00ca-4bf0-980f-b39ffc3b33f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:17:48.138795 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-19ffaa4e-00ca-4bf0-980f-b39ffc3b33f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: b7d2637b-e308-49ad-a633-946086696188] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:17:48.147377 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-19ffaa4e-00ca-4bf0-980f-b39ffc3b33f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:48.147825 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-19ffaa4e-00ca-4bf0-980f-b39ffc3b33f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:48.148597 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-19ffaa4e-00ca-4bf0-980f-b39ffc3b33f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:48.149029 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-19ffaa4e-00ca-4bf0-980f-b39ffc3b33f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:48.162597 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-19ffaa4e-00ca-4bf0-980f-b39ffc3b33f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] HTTP exception thrown: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-19ffaa4e-00ca-4bf0-980f-b39ffc3b33f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Request method failure captured: Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 HTTP/1.1 Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimggsCu1QqC4sdBq_S3SgbeYiDpuNEHjM4Y87AKRUvxbU1aziVyBQldQOcYxH0V14gqDyyCm56eWgfn0N0mQx5EI9Rmc1M0Pk79Ij3qSH5ZhZ7uH7w37JulL1vhPJWdq2uKDhjMmDzBGdWFszMCxST2aUlnMdQpfs0u8vHW0W4X6moII Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 020ed9813c614d2eae9568ba85728136 Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:17:48.164279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:17:48.165922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/020ed9813c614d2eae9568ba85728136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_020ed9813c614d2eae9568ba85728136"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/020ed9813c614d2eae9568ba85728136"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/020ed9813c614d2eae9568ba85728136"}]}] Jun 03 13:17:48.165922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:48.165922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 020ed9813c614d2eae9568ba85728136 Jun 03 13:17:48.165922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:48.165922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeShelveTestJSON-1022356808-project Jun 03 13:17:48.165922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:17:48.165922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:17:48.165922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 49b596abb9a5466595eec1a8fb25d5a1 Jun 03 13:17:48.165922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1022356808-project Jun 03 13:17:48.165922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:17:48.165922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:48.165922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': 'b7d2637b-e308-49ad-a633-946086696188'} Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:17:48.166907 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. Jun 03 13:17:48.168386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:17:48.169778 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-19ffaa4e-00ca-4bf0-980f-b39ffc3b33f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Returning 404 to user: Instance b7d2637b-e308-49ad-a633-946086696188 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:17:48.169778 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-19ffaa4e-00ca-4bf0-980f-b39ffc3b33f2 tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188" status: 404 len: 111 microversion: 2.20 time: 0.034571 Jun 03 13:17:48.169778 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 445/882] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:17:48 2022] GET /compute/v2.1/servers/b7d2637b-e308-49ad-a633-946086696188 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:17:49.318733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-21661c4d-3392-4618-aa7d-b95c358507cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:17:49.319262 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-21661c4d-3392-4618-aa7d-b95c358507cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:17:49.325893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21661c4d-3392-4618-aa7d-b95c358507cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:49.326373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21661c4d-3392-4618-aa7d-b95c358507cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:49.327148 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21661c4d-3392-4618-aa7d-b95c358507cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:49.327581 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-21661c4d-3392-4618-aa7d-b95c358507cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:49.341905 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-21661c4d-3392-4618-aa7d-b95c358507cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] HTTP exception thrown: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-21661c4d-3392-4618-aa7d-b95c358507cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Request method failure captured: Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: DELETE /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 HTTP/1.1 Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimggsCu1QqC4sdBq_S3SgbeYiDpuNEHjM4Y87AKRUvxbU1aziVyBQldQOcYxH0V14gqDyyCm56eWgfn0N0mQx5EI9Rmc1M0Pk79Ij3qSH5ZhZ7uH7w37JulL1vhPJWdq2uKDhjMmDzBGdWFszMCxST2aUlnMdQpfs0u8vHW0W4X6moII Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 020ed9813c614d2eae9568ba85728136 Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:17:49.343496 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:17:49.345145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/020ed9813c614d2eae9568ba85728136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_020ed9813c614d2eae9568ba85728136"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/020ed9813c614d2eae9568ba85728136"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/020ed9813c614d2eae9568ba85728136"}]}] Jun 03 13:17:49.345145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:49.345145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 020ed9813c614d2eae9568ba85728136 Jun 03 13:17:49.345145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:49.345145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeShelveTestJSON-1022356808-project Jun 03 13:17:49.345145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:17:49.345145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:17:49.345145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 49b596abb9a5466595eec1a8fb25d5a1 Jun 03 13:17:49.345145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1022356808-project Jun 03 13:17:49.345145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:17:49.345145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:17:49.345145 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '0321187a-23dc-4d94-a1d1-e341d8fdf035'} Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:17:49.345995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:17:49.347830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:17:49.349274 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-21661c4d-3392-4618-aa7d-b95c358507cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Returning 404 to user: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:17:49.349274 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-21661c4d-3392-4618-aa7d-b95c358507cb tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 404 len: 111 microversion: 2.20 time: 0.030636 Jun 03 13:17:49.349274 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 438/883] 10.222.0.58 () {60 vars in 1279 bytes} [Fri Jun 3 13:17:49 2022] DELETE /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:17:49.353922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-269c24ff-4257-4a45-b7f0-3eb9fbc92cba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:17:49.354630 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-269c24ff-4257-4a45-b7f0-3eb9fbc92cba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] [instance: 0321187a-23dc-4d94-a1d1-e341d8fdf035] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:17:49.360738 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-269c24ff-4257-4a45-b7f0-3eb9fbc92cba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:49.361186 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-269c24ff-4257-4a45-b7f0-3eb9fbc92cba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:49.361948 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-269c24ff-4257-4a45-b7f0-3eb9fbc92cba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:17:49.362405 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-269c24ff-4257-4a45-b7f0-3eb9fbc92cba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:17:49.375945 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-269c24ff-4257-4a45-b7f0-3eb9fbc92cba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] HTTP exception thrown: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-269c24ff-4257-4a45-b7f0-3eb9fbc92cba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Request method failure captured: Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 HTTP/1.1 Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimggsCu1QqC4sdBq_S3SgbeYiDpuNEHjM4Y87AKRUvxbU1aziVyBQldQOcYxH0V14gqDyyCm56eWgfn0N0mQx5EI9Rmc1M0Pk79Ij3qSH5ZhZ7uH7w37JulL1vhPJWdq2uKDhjMmDzBGdWFszMCxST2aUlnMdQpfs0u8vHW0W4X6moII Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 020ed9813c614d2eae9568ba85728136 Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:17:49.377461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:17:49.379256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/020ed9813c614d2eae9568ba85728136"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_020ed9813c614d2eae9568ba85728136"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/020ed9813c614d2eae9568ba85728136"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/020ed9813c614d2eae9568ba85728136"}]}] Jun 03 13:17:49.379256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:49.379256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 020ed9813c614d2eae9568ba85728136 Jun 03 13:17:49.379256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1022356808 Jun 03 13:17:49.379256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeShelveTestJSON-1022356808-project Jun 03 13:17:49.379256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:17:49.379256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:17:49.379256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 49b596abb9a5466595eec1a8fb25d5a1 Jun 03 13:17:49.379256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1022356808-project Jun 03 13:17:49.379256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:17:49.379256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:17:49.379256 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '0321187a-23dc-4d94-a1d1-e341d8fdf035'} Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:17:49.380118 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. Jun 03 13:17:49.381591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:17:49.382964 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-269c24ff-4257-4a45-b7f0-3eb9fbc92cba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] Returning 404 to user: Instance 0321187a-23dc-4d94-a1d1-e341d8fdf035 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:17:49.382964 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-269c24ff-4257-4a45-b7f0-3eb9fbc92cba tempest-AttachVolumeShelveTestJSON-1022356808 tempest-AttachVolumeShelveTestJSON-1022356808-project] 10.222.0.58 "GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035" status: 404 len: 111 microversion: 2.20 time: 0.029210 Jun 03 13:17:49.382964 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 446/884] 10.222.0.58 () {60 vars in 1276 bytes} [Fri Jun 3 13:17:49 2022] GET /compute/v2.1/servers/0321187a-23dc-4d94-a1d1-e341d8fdf035 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:17:58.196491 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-15806dc1-d8f2-4547-bd51-bf333ba16ed0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Action: 'create', calling method: .version_select at 0x7fc5a4ea7310>, body: {"keypair": {"name": "tempest-keypair-1446833669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyFD6k3u/BTlH+LBU6baA5HWNI7ljdMEkVhoEvm42WgXqGxhPnF2Q7Mjdzgj1CPyJqwy+nHPGRgaUBgVG+4HMgaiHYmiysIjEywN7QefyIJZuwyKMoZhJgD+132p6/OrA=="}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:17:58.211168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-15806dc1-d8f2-4547-bd51-bf333ba16ed0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Getting quotas for project 8c86bae74a9443368c08e697fd4a9048. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:17:58.215267 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-15806dc1-d8f2-4547-bd51-bf333ba16ed0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Getting quotas for user 8742453c42ae4d9a8e4b996d628d5f90 and project 8c86bae74a9443368c08e697fd4a9048. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:17:58.243895 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-15806dc1-d8f2-4547-bd51-bf333ba16ed0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166446 Jun 03 13:17:58.244482 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 439/885] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Jun 3 13:17:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:17:59.554352 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1961517635", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12dd50c6-1515-4eb0-ac2d-a6103b95977b"}], "security_groups": [{"name": "tempest-securitygroup--1681726976"}], "key_name": "tempest-keypair-1446833669", "user_data": "}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:17:59.568343 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:59.569496 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:17:59.673585 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] validate_networks() for [('12dd50c6-1515-4eb0-ac2d-a6103b95977b', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:18:00.108516 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:18:00.108973 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:18:00.109446 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:18:00.109876 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:18:00.110332 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:18:00.123236 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:00.123949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:00.124942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:00.125387 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:00.144013 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Getting quotas for project 8c86bae74a9443368c08e697fd4a9048. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:18:00.149258 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Getting quotas for user 8742453c42ae4d9a8e4b996d628d5f90 and project 8c86bae74a9443368c08e697fd4a9048. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:18:00.162996 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:18:00.165225 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:18:00.241587 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-eb891bca-bb28-4c26-8629-0f15aa2136fa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.692074 Jun 03 13:18:00.242254 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 447/886] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:17:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:18:00.249694 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=20 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:18:00.254363 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-99f6bc97-19ba-491f-800f-2b4eef7450fe tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:18:00.254992 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-99f6bc97-19ba-491f-800f-2b4eef7450fe tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:18:00.333550 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-99f6bc97-19ba-491f-800f-2b4eef7450fe tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:18:00.341798 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-99f6bc97-19ba-491f-800f-2b4eef7450fe tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1238 microversion: 2.1 time: 0.093283 Jun 03 13:18:00.343561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 440/887] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:18:00 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:18:01.361337 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ece9d11c-6842-407f-9c59-8cbce10efecd tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:18:01.361953 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ece9d11c-6842-407f-9c59-8cbce10efecd tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:18:01.370582 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ece9d11c-6842-407f-9c59-8cbce10efecd tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:01.371378 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ece9d11c-6842-407f-9c59-8cbce10efecd tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:01.372965 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ece9d11c-6842-407f-9c59-8cbce10efecd tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:01.373685 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ece9d11c-6842-407f-9c59-8cbce10efecd tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:01.452563 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ece9d11c-6842-407f-9c59-8cbce10efecd tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:18:01.461523 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ece9d11c-6842-407f-9c59-8cbce10efecd tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1296 microversion: 2.1 time: 0.105152 Jun 03 13:18:01.462100 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 448/888] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:18:01 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:18:02.478847 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-94a4ca98-bed4-4e14-8a4a-2064b4848224 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:18:02.480245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-94a4ca98-bed4-4e14-8a4a-2064b4848224 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:18:02.486838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94a4ca98-bed4-4e14-8a4a-2064b4848224 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:02.487359 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94a4ca98-bed4-4e14-8a4a-2064b4848224 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:02.488599 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94a4ca98-bed4-4e14-8a4a-2064b4848224 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:02.489367 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94a4ca98-bed4-4e14-8a4a-2064b4848224 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:02.633942 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-94a4ca98-bed4-4e14-8a4a-2064b4848224 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:18:02.641471 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-94a4ca98-bed4-4e14-8a4a-2064b4848224 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1364 microversion: 2.1 time: 0.166559 Jun 03 13:18:02.642045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 441/889] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:18:02 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:18:02.695456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-5492e369-df0a-43fb-95b0-d2bb97682841 req-a912ec92-658f-4b01-bdec-766db0b730a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03cd556a-7089-4497-b35f-9124779bbe9d", "tag": "8f66b934-4fb4-4e26-a706-64a3b5880265"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:18:02.708637 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-5492e369-df0a-43fb-95b0-d2bb97682841 req-a912ec92-658f-4b01-bdec-766db0b730a7 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:02.709950 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-5492e369-df0a-43fb-95b0-d2bb97682841 req-a912ec92-658f-4b01-bdec-766db0b730a7 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:02.723949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-5492e369-df0a-43fb-95b0-d2bb97682841 req-a912ec92-658f-4b01-bdec-766db0b730a7 service nova] Creating event network-changed:8f66b934-4fb4-4e26-a706-64a3b5880265 for instance 03cd556a-7089-4497-b35f-9124779bbe9d on hv-cinder-77954 Jun 03 13:18:02.729357 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-5492e369-df0a-43fb-95b0-d2bb97682841 req-a912ec92-658f-4b01-bdec-766db0b730a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037807 Jun 03 13:18:02.730662 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 449/890] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:18:03.665269 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a43b398c-93c2-4065-a7ca-8dab49bc5876 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:18:03.668571 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a43b398c-93c2-4065-a7ca-8dab49bc5876 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:18:03.678327 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a43b398c-93c2-4065-a7ca-8dab49bc5876 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:03.678908 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a43b398c-93c2-4065-a7ca-8dab49bc5876 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:03.680085 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a43b398c-93c2-4065-a7ca-8dab49bc5876 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:03.680686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a43b398c-93c2-4065-a7ca-8dab49bc5876 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:03.833422 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-a43b398c-93c2-4065-a7ca-8dab49bc5876 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:18:03.844502 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a43b398c-93c2-4065-a7ca-8dab49bc5876 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1364 microversion: 2.1 time: 0.188324 Jun 03 13:18:03.845247 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 442/891] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:18:03 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:18:04.869268 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c9696416-049e-451f-898e-7b79fce53e0f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:18:04.870303 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c9696416-049e-451f-898e-7b79fce53e0f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:18:04.881217 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9696416-049e-451f-898e-7b79fce53e0f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:04.881698 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9696416-049e-451f-898e-7b79fce53e0f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:04.882567 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9696416-049e-451f-898e-7b79fce53e0f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:04.883015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c9696416-049e-451f-898e-7b79fce53e0f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:05.028755 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c9696416-049e-451f-898e-7b79fce53e0f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:18:05.043378 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c9696416-049e-451f-898e-7b79fce53e0f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1364 microversion: 2.1 time: 0.180655 Jun 03 13:18:05.044210 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 450/892] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:18:04 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:18:06.061659 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4c6bd923-180e-443b-a200-042edc3dce4d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:18:06.062402 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4c6bd923-180e-443b-a200-042edc3dce4d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:18:06.069959 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c6bd923-180e-443b-a200-042edc3dce4d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:06.070476 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c6bd923-180e-443b-a200-042edc3dce4d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:06.071257 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c6bd923-180e-443b-a200-042edc3dce4d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:06.071708 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4c6bd923-180e-443b-a200-042edc3dce4d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:06.202434 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4c6bd923-180e-443b-a200-042edc3dce4d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:18:06.210246 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4c6bd923-180e-443b-a200-042edc3dce4d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1364 microversion: 2.1 time: 0.153064 Jun 03 13:18:06.210824 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 443/893] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:18:06 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:18:07.230426 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9b6768be-1158-480e-abf8-f97a928e725b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:18:07.231149 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9b6768be-1158-480e-abf8-f97a928e725b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:18:07.240434 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b6768be-1158-480e-abf8-f97a928e725b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:07.240993 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b6768be-1158-480e-abf8-f97a928e725b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:07.242155 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b6768be-1158-480e-abf8-f97a928e725b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:07.242747 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9b6768be-1158-480e-abf8-f97a928e725b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:07.381214 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9b6768be-1158-480e-abf8-f97a928e725b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:18:07.389528 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9b6768be-1158-480e-abf8-f97a928e725b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1364 microversion: 2.1 time: 0.164670 Jun 03 13:18:07.390130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 451/894] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:18:07 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:18:08.103119 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-1afe5052-f95b-435b-97d6-f1c970086879 req-5c902158-73db-4830-984b-e12c28f6f5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cd556a-7089-4497-b35f-9124779bbe9d", "name": "network-vif-plugged", "status": "completed", "tag": "8f66b934-4fb4-4e26-a706-64a3b5880265"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:18:08.112448 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-1afe5052-f95b-435b-97d6-f1c970086879 req-5c902158-73db-4830-984b-e12c28f6f5c0 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:08.112911 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-1afe5052-f95b-435b-97d6-f1c970086879 req-5c902158-73db-4830-984b-e12c28f6f5c0 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:08.125758 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-1afe5052-f95b-435b-97d6-f1c970086879 req-5c902158-73db-4830-984b-e12c28f6f5c0 service nova] Creating event network-vif-plugged:8f66b934-4fb4-4e26-a706-64a3b5880265 for instance 03cd556a-7089-4497-b35f-9124779bbe9d on hv-cinder-77954 Jun 03 13:18:08.130899 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-1afe5052-f95b-435b-97d6-f1c970086879 req-5c902158-73db-4830-984b-e12c28f6f5c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032268 Jun 03 13:18:08.131497 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 444/895] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:18:08.410019 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-05326d2a-669b-4353-9833-0b0c485f82d4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:18:08.410996 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-05326d2a-669b-4353-9833-0b0c485f82d4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:18:08.422770 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-05326d2a-669b-4353-9833-0b0c485f82d4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:08.423525 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-05326d2a-669b-4353-9833-0b0c485f82d4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:08.424816 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-05326d2a-669b-4353-9833-0b0c485f82d4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:08.425547 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-05326d2a-669b-4353-9833-0b0c485f82d4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:08.561893 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-05326d2a-669b-4353-9833-0b0c485f82d4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:18:08.569506 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-05326d2a-669b-4353-9833-0b0c485f82d4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1364 microversion: 2.1 time: 0.166085 Jun 03 13:18:08.570035 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 452/896] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:18:08 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:18:09.588718 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-95b3030c-fbf5-4d25-844d-59c11491ea64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:18:09.589446 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-95b3030c-fbf5-4d25-844d-59c11491ea64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:18:09.596481 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95b3030c-fbf5-4d25-844d-59c11491ea64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:09.596937 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95b3030c-fbf5-4d25-844d-59c11491ea64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:09.597702 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95b3030c-fbf5-4d25-844d-59c11491ea64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:09.598154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-95b3030c-fbf5-4d25-844d-59c11491ea64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:09.733307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-95b3030c-fbf5-4d25-844d-59c11491ea64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:18:09.741228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-95b3030c-fbf5-4d25-844d-59c11491ea64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1364 microversion: 2.1 time: 0.157331 Jun 03 13:18:09.741808 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 445/897] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:18:09 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:18:10.763316 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-87beb204-b1af-42a0-aebd-ddbe65014b1f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:18:10.764343 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-87beb204-b1af-42a0-aebd-ddbe65014b1f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:18:10.768133 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:18:10.769752 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:18:10.778471 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87beb204-b1af-42a0-aebd-ddbe65014b1f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:10.778947 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87beb204-b1af-42a0-aebd-ddbe65014b1f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:10.779836 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87beb204-b1af-42a0-aebd-ddbe65014b1f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:10.780804 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-87beb204-b1af-42a0-aebd-ddbe65014b1f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:10.923823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-87beb204-b1af-42a0-aebd-ddbe65014b1f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:18:10.935315 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-87beb204-b1af-42a0-aebd-ddbe65014b1f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1549 microversion: 2.1 time: 0.179011 Jun 03 13:18:10.936020 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 453/898] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:18:10 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1549 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:18:10.952470 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-84b4a114-248c-4bae-a5d2-5dfb8cf79cf4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:18:10.953071 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-84b4a114-248c-4bae-a5d2-5dfb8cf79cf4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:18:10.955283 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:18:10.961359 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84b4a114-248c-4bae-a5d2-5dfb8cf79cf4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:10.961859 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84b4a114-248c-4bae-a5d2-5dfb8cf79cf4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:10.962660 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84b4a114-248c-4bae-a5d2-5dfb8cf79cf4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:10.963101 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-84b4a114-248c-4bae-a5d2-5dfb8cf79cf4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:11.048610 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-84b4a114-248c-4bae-a5d2-5dfb8cf79cf4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100047 Jun 03 13:18:11.049256 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 446/899] 10.222.0.58 () {58 vars in 1274 bytes} [Fri Jun 3 13:18:10 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:18:12.403269 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-6613c359-c32d-47a6-bf22-1204c6887f51 req-d4a19d07-38ee-4760-8ded-ea9aa8816cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03cd556a-7089-4497-b35f-9124779bbe9d", "tag": "8f66b934-4fb4-4e26-a706-64a3b5880265"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:18:12.411913 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-6613c359-c32d-47a6-bf22-1204c6887f51 req-d4a19d07-38ee-4760-8ded-ea9aa8816cea service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:18:12.412345 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-6613c359-c32d-47a6-bf22-1204c6887f51 req-d4a19d07-38ee-4760-8ded-ea9aa8816cea service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:18:12.426140 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-6613c359-c32d-47a6-bf22-1204c6887f51 req-d4a19d07-38ee-4760-8ded-ea9aa8816cea service nova] Creating event network-changed:8f66b934-4fb4-4e26-a706-64a3b5880265 for instance 03cd556a-7089-4497-b35f-9124779bbe9d on hv-cinder-77954 Jun 03 13:18:12.431250 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-6613c359-c32d-47a6-bf22-1204c6887f51 req-d4a19d07-38ee-4760-8ded-ea9aa8816cea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031780 Jun 03 13:18:12.432002 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 454/900] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:19:03.639228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:19:03.640141 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Fri Jun 3 13:19:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:19:17.133291 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:19:17.134413 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=30 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:19:17.142637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d3610d02-450f-46d1-8722-980f88a70f0d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:17.143136 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d3610d02-450f-46d1-8722-980f88a70f0d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:17.150739 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3610d02-450f-46d1-8722-980f88a70f0d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:17.151198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3610d02-450f-46d1-8722-980f88a70f0d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:17.151975 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3610d02-450f-46d1-8722-980f88a70f0d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:17.152413 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d3610d02-450f-46d1-8722-980f88a70f0d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:17.177025 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d3610d02-450f-46d1-8722-980f88a70f0d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/ips" status: 200 len: 145 microversion: 2.1 time: 0.047286 Jun 03 13:19:17.177592 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 447/901] 10.222.0.58 () {58 vars in 1247 bytes} [Fri Jun 3 13:19:17 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:19:20.002724 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:19:20.003704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=36 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:19:20.010254 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-166162ac-934e-42a0-a77e-4d5d7ff30216 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b0aa5e8-3233-4c1a-8d79-54c6577d5022"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:19:20.011911 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-166162ac-934e-42a0-a77e-4d5d7ff30216 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:20.021700 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-166162ac-934e-42a0-a77e-4d5d7ff30216 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:20.022151 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-166162ac-934e-42a0-a77e-4d5d7ff30216 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:20.022936 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-166162ac-934e-42a0-a77e-4d5d7ff30216 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:20.023372 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-166162ac-934e-42a0-a77e-4d5d7ff30216 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:20.290072 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-166162ac-934e-42a0-a77e-4d5d7ff30216 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "POST /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289219 Jun 03 13:19:20.290702 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 455/902] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:19:19 2022] POST /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:19:27.847938 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7e17b575-6a7c-4d8d-8eba-6d3557cd568c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:19:27.850688 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:19:27.851328 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=4 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:19:27.856844 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e17b575-6a7c-4d8d-8eba-6d3557cd568c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:27.857294 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7e17b575-6a7c-4d8d-8eba-6d3557cd568c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:27.924408 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7e17b575-6a7c-4d8d-8eba-6d3557cd568c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Going to try to stop instance {{(pid=117726) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 13:19:27.984419 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7e17b575-6a7c-4d8d-8eba-6d3557cd568c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "POST /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/action" status: 202 len: 0 microversion: 2.1 time: 0.140237 Jun 03 13:19:27.985009 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 448/903] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:19:27 2022] POST /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:19:27.994658 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-61369d08-8bdf-4616-9eee-5331dd636fb0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:27.995371 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-61369d08-8bdf-4616-9eee-5331dd636fb0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:28.002141 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-61369d08-8bdf-4616-9eee-5331dd636fb0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:28.002624 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-61369d08-8bdf-4616-9eee-5331dd636fb0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:28.003424 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-61369d08-8bdf-4616-9eee-5331dd636fb0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:28.003865 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-61369d08-8bdf-4616-9eee-5331dd636fb0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:28.139828 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-61369d08-8bdf-4616-9eee-5331dd636fb0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:28.148578 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-61369d08-8bdf-4616-9eee-5331dd636fb0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.158681 Jun 03 13:19:28.149178 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 456/904] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:27 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:29.172015 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7b815fbd-e911-4a4b-916a-878c25de1d2b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:29.173043 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7b815fbd-e911-4a4b-916a-878c25de1d2b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:29.181355 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7b815fbd-e911-4a4b-916a-878c25de1d2b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:29.181815 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7b815fbd-e911-4a4b-916a-878c25de1d2b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:29.182628 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7b815fbd-e911-4a4b-916a-878c25de1d2b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:29.183068 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7b815fbd-e911-4a4b-916a-878c25de1d2b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:29.322663 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7b815fbd-e911-4a4b-916a-878c25de1d2b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:29.335172 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7b815fbd-e911-4a4b-916a-878c25de1d2b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.170861 Jun 03 13:19:29.336022 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 449/905] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:29 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:30.357569 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-f268c880-da31-4237-8016-22568ff3a6ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:30.358556 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-f268c880-da31-4237-8016-22568ff3a6ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:30.370101 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f268c880-da31-4237-8016-22568ff3a6ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:30.370906 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f268c880-da31-4237-8016-22568ff3a6ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:30.372181 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f268c880-da31-4237-8016-22568ff3a6ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:30.372896 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-f268c880-da31-4237-8016-22568ff3a6ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:30.504322 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-f268c880-da31-4237-8016-22568ff3a6ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:30.512283 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-f268c880-da31-4237-8016-22568ff3a6ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.161603 Jun 03 13:19:30.512858 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 457/906] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:30 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:31.533394 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c6aa5ae3-19c5-4677-8639-255ec819b0c0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:31.534501 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c6aa5ae3-19c5-4677-8639-255ec819b0c0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:31.543299 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6aa5ae3-19c5-4677-8639-255ec819b0c0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:31.543769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6aa5ae3-19c5-4677-8639-255ec819b0c0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:31.544936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6aa5ae3-19c5-4677-8639-255ec819b0c0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:31.544936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c6aa5ae3-19c5-4677-8639-255ec819b0c0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:31.698630 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c6aa5ae3-19c5-4677-8639-255ec819b0c0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:31.711022 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c6aa5ae3-19c5-4677-8639-255ec819b0c0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.183917 Jun 03 13:19:31.711770 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 450/907] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:31 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:32.737003 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7bdb20a9-6090-4873-a9f7-3bd8da9b32d8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:32.737940 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7bdb20a9-6090-4873-a9f7-3bd8da9b32d8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:32.746493 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bdb20a9-6090-4873-a9f7-3bd8da9b32d8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:32.746944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bdb20a9-6090-4873-a9f7-3bd8da9b32d8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:32.747715 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bdb20a9-6090-4873-a9f7-3bd8da9b32d8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:32.748143 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7bdb20a9-6090-4873-a9f7-3bd8da9b32d8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:32.890060 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7bdb20a9-6090-4873-a9f7-3bd8da9b32d8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:32.899099 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7bdb20a9-6090-4873-a9f7-3bd8da9b32d8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.168652 Jun 03 13:19:32.899714 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 458/908] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:32 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:33.920073 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-94e689f0-13af-4686-8b7d-dfffaca2fc39 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:33.921001 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-94e689f0-13af-4686-8b7d-dfffaca2fc39 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:33.932096 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94e689f0-13af-4686-8b7d-dfffaca2fc39 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:33.932848 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94e689f0-13af-4686-8b7d-dfffaca2fc39 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:33.934089 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94e689f0-13af-4686-8b7d-dfffaca2fc39 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:33.934850 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-94e689f0-13af-4686-8b7d-dfffaca2fc39 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:34.083069 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-94e689f0-13af-4686-8b7d-dfffaca2fc39 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:34.092161 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-94e689f0-13af-4686-8b7d-dfffaca2fc39 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.178819 Jun 03 13:19:34.092740 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 451/909] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:33 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:35.114527 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ae1f1f99-1e31-4ece-b909-ad7f7deb979d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:35.115447 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ae1f1f99-1e31-4ece-b909-ad7f7deb979d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:35.123193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae1f1f99-1e31-4ece-b909-ad7f7deb979d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:35.123650 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae1f1f99-1e31-4ece-b909-ad7f7deb979d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:35.124422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae1f1f99-1e31-4ece-b909-ad7f7deb979d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:35.124863 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae1f1f99-1e31-4ece-b909-ad7f7deb979d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:35.285965 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ae1f1f99-1e31-4ece-b909-ad7f7deb979d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:35.294461 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ae1f1f99-1e31-4ece-b909-ad7f7deb979d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.186963 Jun 03 13:19:35.295393 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 459/910] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:35 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:36.316487 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b62ec313-1e49-4aac-b5ce-856018d683bf tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:36.317469 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b62ec313-1e49-4aac-b5ce-856018d683bf tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:36.325344 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b62ec313-1e49-4aac-b5ce-856018d683bf tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:36.325812 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b62ec313-1e49-4aac-b5ce-856018d683bf tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:36.326596 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b62ec313-1e49-4aac-b5ce-856018d683bf tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:36.327025 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b62ec313-1e49-4aac-b5ce-856018d683bf tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:36.467976 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b62ec313-1e49-4aac-b5ce-856018d683bf tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:36.477034 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b62ec313-1e49-4aac-b5ce-856018d683bf tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.167039 Jun 03 13:19:36.477609 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 452/911] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:36 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:37.497203 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bbb11d01-21e9-4253-aeb5-747a8279e241 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:37.497905 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bbb11d01-21e9-4253-aeb5-747a8279e241 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:37.505507 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbb11d01-21e9-4253-aeb5-747a8279e241 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:37.506006 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbb11d01-21e9-4253-aeb5-747a8279e241 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:37.507534 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbb11d01-21e9-4253-aeb5-747a8279e241 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:37.507986 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bbb11d01-21e9-4253-aeb5-747a8279e241 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:37.664560 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bbb11d01-21e9-4253-aeb5-747a8279e241 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:37.673477 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bbb11d01-21e9-4253-aeb5-747a8279e241 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.180724 Jun 03 13:19:37.674093 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 460/912] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:37 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:38.694032 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ad8ed5f1-e77f-49ae-918e-34f3a0ee6d60 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:38.695139 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ad8ed5f1-e77f-49ae-918e-34f3a0ee6d60 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:38.705812 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad8ed5f1-e77f-49ae-918e-34f3a0ee6d60 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:38.706500 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad8ed5f1-e77f-49ae-918e-34f3a0ee6d60 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:38.707599 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad8ed5f1-e77f-49ae-918e-34f3a0ee6d60 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:38.708222 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ad8ed5f1-e77f-49ae-918e-34f3a0ee6d60 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:38.852631 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ad8ed5f1-e77f-49ae-918e-34f3a0ee6d60 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:38.864730 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ad8ed5f1-e77f-49ae-918e-34f3a0ee6d60 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.176104 Jun 03 13:19:38.865602 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 453/913] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:38 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:39.887388 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-854a2caa-48cf-4508-b07a-5c097f84c5ae tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:39.888261 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-854a2caa-48cf-4508-b07a-5c097f84c5ae tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:39.899295 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-854a2caa-48cf-4508-b07a-5c097f84c5ae tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:39.900100 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-854a2caa-48cf-4508-b07a-5c097f84c5ae tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:39.901413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-854a2caa-48cf-4508-b07a-5c097f84c5ae tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:39.902160 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-854a2caa-48cf-4508-b07a-5c097f84c5ae tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:40.050516 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-854a2caa-48cf-4508-b07a-5c097f84c5ae tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:40.058938 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-854a2caa-48cf-4508-b07a-5c097f84c5ae tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.178580 Jun 03 13:19:40.059526 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 461/914] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:39 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:41.076652 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-55bcb21f-6288-4125-955b-2d7a2d220ca8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:41.077223 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-55bcb21f-6288-4125-955b-2d7a2d220ca8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:41.084168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-55bcb21f-6288-4125-955b-2d7a2d220ca8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:41.084621 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-55bcb21f-6288-4125-955b-2d7a2d220ca8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:41.085379 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-55bcb21f-6288-4125-955b-2d7a2d220ca8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:41.085811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-55bcb21f-6288-4125-955b-2d7a2d220ca8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:41.227874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-55bcb21f-6288-4125-955b-2d7a2d220ca8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:41.236773 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-55bcb21f-6288-4125-955b-2d7a2d220ca8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.164180 Jun 03 13:19:41.237388 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 454/915] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:41 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:42.258728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-891a9b0a-d701-48c2-8f3d-7a0f693a96ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:42.259802 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-891a9b0a-d701-48c2-8f3d-7a0f693a96ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:42.271215 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-891a9b0a-d701-48c2-8f3d-7a0f693a96ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:42.271986 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-891a9b0a-d701-48c2-8f3d-7a0f693a96ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:42.273269 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-891a9b0a-d701-48c2-8f3d-7a0f693a96ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:42.274013 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-891a9b0a-d701-48c2-8f3d-7a0f693a96ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:42.411481 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-891a9b0a-d701-48c2-8f3d-7a0f693a96ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:42.420269 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-891a9b0a-d701-48c2-8f3d-7a0f693a96ed tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1724 microversion: 2.1 time: 0.168059 Jun 03 13:19:42.420787 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 462/916] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:42 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:43.439466 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0d456ca6-34d9-4006-8b6c-4fa53d38f3d7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:43.440290 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0d456ca6-34d9-4006-8b6c-4fa53d38f3d7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:43.449250 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d456ca6-34d9-4006-8b6c-4fa53d38f3d7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:43.449694 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d456ca6-34d9-4006-8b6c-4fa53d38f3d7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:43.450489 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d456ca6-34d9-4006-8b6c-4fa53d38f3d7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:43.450914 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0d456ca6-34d9-4006-8b6c-4fa53d38f3d7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:43.601608 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0d456ca6-34d9-4006-8b6c-4fa53d38f3d7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:43.610409 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0d456ca6-34d9-4006-8b6c-4fa53d38f3d7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1701 microversion: 2.1 time: 0.176375 Jun 03 13:19:43.610978 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 455/917] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:43 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1701 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:43.627348 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4cf0ce4d-46d9-47d3-83cc-5ade2cd504e5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:19:43.634406 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4cf0ce4d-46d9-47d3-83cc-5ade2cd504e5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:43.634858 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4cf0ce4d-46d9-47d3-83cc-5ade2cd504e5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:43.697279 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4cf0ce4d-46d9-47d3-83cc-5ade2cd504e5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Going to try to start instance {{(pid=117727) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 13:19:43.745183 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4cf0ce4d-46d9-47d3-83cc-5ade2cd504e5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "POST /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/action" status: 202 len: 0 microversion: 2.1 time: 0.121320 Jun 03 13:19:43.745772 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 463/918] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:19:43 2022] POST /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:19:43.754051 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9a87a51c-4953-4262-b062-43953fad6f5c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:43.754687 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9a87a51c-4953-4262-b062-43953fad6f5c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:43.761483 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a87a51c-4953-4262-b062-43953fad6f5c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:43.762081 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a87a51c-4953-4262-b062-43953fad6f5c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:43.762833 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a87a51c-4953-4262-b062-43953fad6f5c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:43.763266 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9a87a51c-4953-4262-b062-43953fad6f5c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:43.897220 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9a87a51c-4953-4262-b062-43953fad6f5c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:43.905770 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9a87a51c-4953-4262-b062-43953fad6f5c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1710 microversion: 2.1 time: 0.155515 Jun 03 13:19:43.906493 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 456/919] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:43 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:44.925191 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ae39b939-cae1-4c2c-a2db-7a335349ef8c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:44.925881 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ae39b939-cae1-4c2c-a2db-7a335349ef8c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:44.932898 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae39b939-cae1-4c2c-a2db-7a335349ef8c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:44.933357 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae39b939-cae1-4c2c-a2db-7a335349ef8c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:44.934173 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae39b939-cae1-4c2c-a2db-7a335349ef8c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:44.934612 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae39b939-cae1-4c2c-a2db-7a335349ef8c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:45.086360 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ae39b939-cae1-4c2c-a2db-7a335349ef8c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:45.098869 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ae39b939-cae1-4c2c-a2db-7a335349ef8c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1710 microversion: 2.1 time: 0.178097 Jun 03 13:19:45.099647 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 464/920] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:44 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1710 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:19:46.121055 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b38cbacb-de09-4592-b6a4-856ca23c244e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:19:46.122422 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b38cbacb-de09-4592-b6a4-856ca23c244e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:19:46.129536 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b38cbacb-de09-4592-b6a4-856ca23c244e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:46.129990 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b38cbacb-de09-4592-b6a4-856ca23c244e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:46.130835 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b38cbacb-de09-4592-b6a4-856ca23c244e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:19:46.131276 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b38cbacb-de09-4592-b6a4-856ca23c244e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:19:46.268801 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b38cbacb-de09-4592-b6a4-856ca23c244e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:19:46.277303 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b38cbacb-de09-4592-b6a4-856ca23c244e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1714 microversion: 2.1 time: 0.163554 Jun 03 13:19:46.277859 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 457/921] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:19:46 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1714 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:34.954165 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8417a10e-c3b9-4ca1-8e00-dc3f9f52acc4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:34.955038 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8417a10e-c3b9-4ca1-8e00-dc3f9f52acc4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:34.958170 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=20 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:20:34.959191 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:20:34.971105 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8417a10e-c3b9-4ca1-8e00-dc3f9f52acc4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:34.971600 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8417a10e-c3b9-4ca1-8e00-dc3f9f52acc4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:34.972429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8417a10e-c3b9-4ca1-8e00-dc3f9f52acc4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:34.972855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8417a10e-c3b9-4ca1-8e00-dc3f9f52acc4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:35.065570 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-8417a10e-c3b9-4ca1-8e00-dc3f9f52acc4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lazy-loading 'services' on Instance uuid 03cd556a-7089-4497-b35f-9124779bbe9d {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:20:35.146193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8417a10e-c3b9-4ca1-8e00-dc3f9f52acc4 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/os-volume_attachments/7b0aa5e8-3233-4c1a-8d79-54c6577d5022" status: 202 len: 0 microversion: 2.1 time: 0.198639 Jun 03 13:20:35.146762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 465/922] 10.222.0.58 () {58 vars in 1415 bytes} [Fri Jun 3 13:20:34 2022] DELETE /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/os-volume_attachments/7b0aa5e8-3233-4c1a-8d79-54c6577d5022 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:20:36.261769 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2ea76c7c-9dd7-408f-bb9c-66e1fe727603 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:20:36.264076 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=20 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:20:36.264696 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:20:36.271018 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ea76c7c-9dd7-408f-bb9c-66e1fe727603 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:36.271465 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2ea76c7c-9dd7-408f-bb9c-66e1fe727603 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:36.295727 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2ea76c7c-9dd7-408f-bb9c-66e1fe727603 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Going to try to stop instance {{(pid=117726) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 13:20:36.343820 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2ea76c7c-9dd7-408f-bb9c-66e1fe727603 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "POST /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/action" status: 202 len: 0 microversion: 2.1 time: 0.085684 Jun 03 13:20:36.344667 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 458/923] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:20:36 2022] POST /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:20:36.355091 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ba1943f6-dd3c-4d31-b342-0bc8eeb2d598 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:36.355800 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ba1943f6-dd3c-4d31-b342-0bc8eeb2d598 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:36.364601 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba1943f6-dd3c-4d31-b342-0bc8eeb2d598 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:36.365209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba1943f6-dd3c-4d31-b342-0bc8eeb2d598 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:36.366187 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba1943f6-dd3c-4d31-b342-0bc8eeb2d598 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:36.366660 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ba1943f6-dd3c-4d31-b342-0bc8eeb2d598 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:36.503880 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ba1943f6-dd3c-4d31-b342-0bc8eeb2d598 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:20:36.512036 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ba1943f6-dd3c-4d31-b342-0bc8eeb2d598 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1678 microversion: 2.1 time: 0.161897 Jun 03 13:20:36.512613 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 466/924] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:20:36 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:37.534670 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-57fa5f0a-5322-4a0d-9f4f-cd6e35071585 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:37.535762 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-57fa5f0a-5322-4a0d-9f4f-cd6e35071585 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:37.546936 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57fa5f0a-5322-4a0d-9f4f-cd6e35071585 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:37.547729 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57fa5f0a-5322-4a0d-9f4f-cd6e35071585 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:37.549217 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57fa5f0a-5322-4a0d-9f4f-cd6e35071585 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:37.549589 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57fa5f0a-5322-4a0d-9f4f-cd6e35071585 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:37.696916 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-57fa5f0a-5322-4a0d-9f4f-cd6e35071585 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:20:37.708630 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-57fa5f0a-5322-4a0d-9f4f-cd6e35071585 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1678 microversion: 2.1 time: 0.180909 Jun 03 13:20:37.709396 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 459/925] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:20:37 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:38.733700 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5da91ea1-2746-4564-b180-893b6113c0b2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:38.734706 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5da91ea1-2746-4564-b180-893b6113c0b2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:38.746405 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5da91ea1-2746-4564-b180-893b6113c0b2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:38.747166 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5da91ea1-2746-4564-b180-893b6113c0b2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:38.748454 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5da91ea1-2746-4564-b180-893b6113c0b2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:38.749189 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5da91ea1-2746-4564-b180-893b6113c0b2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:38.890921 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5da91ea1-2746-4564-b180-893b6113c0b2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:20:38.900050 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5da91ea1-2746-4564-b180-893b6113c0b2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1678 microversion: 2.1 time: 0.172715 Jun 03 13:20:38.900617 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 467/926] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:20:38 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:39.921135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-dd8d9523-0713-4d46-95e6-1834941845bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:39.922012 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-dd8d9523-0713-4d46-95e6-1834941845bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:39.933412 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dd8d9523-0713-4d46-95e6-1834941845bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:39.934175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dd8d9523-0713-4d46-95e6-1834941845bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:39.935483 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dd8d9523-0713-4d46-95e6-1834941845bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:39.936211 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-dd8d9523-0713-4d46-95e6-1834941845bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:39.962409 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:20:39.962939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Fri Jun 3 13:20:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:20:40.070945 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-dd8d9523-0713-4d46-95e6-1834941845bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:20:40.078714 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-dd8d9523-0713-4d46-95e6-1834941845bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1678 microversion: 2.1 time: 0.164268 Jun 03 13:20:40.079236 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 460/927] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:20:39 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:41.096401 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d1d5432c-3944-410e-942d-c9700ea2bc64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:41.097030 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d1d5432c-3944-410e-942d-c9700ea2bc64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:41.105258 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1d5432c-3944-410e-942d-c9700ea2bc64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:41.105695 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1d5432c-3944-410e-942d-c9700ea2bc64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:41.106549 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1d5432c-3944-410e-942d-c9700ea2bc64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:41.106987 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d1d5432c-3944-410e-942d-c9700ea2bc64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:41.243447 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d1d5432c-3944-410e-942d-c9700ea2bc64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:20:41.251726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d1d5432c-3944-410e-942d-c9700ea2bc64 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1678 microversion: 2.1 time: 0.159383 Jun 03 13:20:41.252266 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 468/928] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:20:41 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:42.273608 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-47250ae7-9538-47b9-8d75-8b58d8259bc6 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:42.274640 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-47250ae7-9538-47b9-8d75-8b58d8259bc6 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:42.286424 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47250ae7-9538-47b9-8d75-8b58d8259bc6 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:42.286935 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47250ae7-9538-47b9-8d75-8b58d8259bc6 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:42.287758 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47250ae7-9538-47b9-8d75-8b58d8259bc6 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:42.288231 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-47250ae7-9538-47b9-8d75-8b58d8259bc6 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:42.433293 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-47250ae7-9538-47b9-8d75-8b58d8259bc6 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:20:42.443684 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-47250ae7-9538-47b9-8d75-8b58d8259bc6 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1678 microversion: 2.1 time: 0.176810 Jun 03 13:20:42.444275 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 461/929] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:20:42 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:43.472606 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2d56646b-cdcc-401e-975c-225f14d1368a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:43.475143 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2d56646b-cdcc-401e-975c-225f14d1368a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:43.486734 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d56646b-cdcc-401e-975c-225f14d1368a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:43.487878 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d56646b-cdcc-401e-975c-225f14d1368a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:43.488677 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d56646b-cdcc-401e-975c-225f14d1368a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:43.489439 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2d56646b-cdcc-401e-975c-225f14d1368a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:43.625962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2d56646b-cdcc-401e-975c-225f14d1368a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:20:43.633840 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2d56646b-cdcc-401e-975c-225f14d1368a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1678 microversion: 2.1 time: 0.169200 Jun 03 13:20:43.634451 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 469/930] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:20:43 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:44.655613 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-be2257bf-36ce-4d8a-beaf-9e7ae855595d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:44.656570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-be2257bf-36ce-4d8a-beaf-9e7ae855595d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:44.665359 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be2257bf-36ce-4d8a-beaf-9e7ae855595d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:44.665812 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be2257bf-36ce-4d8a-beaf-9e7ae855595d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:44.666630 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be2257bf-36ce-4d8a-beaf-9e7ae855595d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:44.667061 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-be2257bf-36ce-4d8a-beaf-9e7ae855595d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:44.798508 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-be2257bf-36ce-4d8a-beaf-9e7ae855595d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:20:44.806651 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-be2257bf-36ce-4d8a-beaf-9e7ae855595d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1678 microversion: 2.1 time: 0.157854 Jun 03 13:20:44.807227 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 462/931] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:20:44 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:45.828249 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2f4df637-e38d-470a-ba84-d34d21368d94 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:45.829145 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2f4df637-e38d-470a-ba84-d34d21368d94 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:45.837602 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f4df637-e38d-470a-ba84-d34d21368d94 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:45.838066 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f4df637-e38d-470a-ba84-d34d21368d94 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:45.838877 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f4df637-e38d-470a-ba84-d34d21368d94 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:45.839325 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2f4df637-e38d-470a-ba84-d34d21368d94 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:45.984782 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2f4df637-e38d-470a-ba84-d34d21368d94 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:20:45.993294 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2f4df637-e38d-470a-ba84-d34d21368d94 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1678 microversion: 2.1 time: 0.171881 Jun 03 13:20:45.993862 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 470/932] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:20:45 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:47.018192 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7eec5f4a-efb1-404a-b258-44e4cea202f2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:47.019220 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7eec5f4a-efb1-404a-b258-44e4cea202f2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:47.030613 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7eec5f4a-efb1-404a-b258-44e4cea202f2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:47.031365 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7eec5f4a-efb1-404a-b258-44e4cea202f2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:47.032638 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7eec5f4a-efb1-404a-b258-44e4cea202f2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:47.033371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7eec5f4a-efb1-404a-b258-44e4cea202f2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:47.196303 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7eec5f4a-efb1-404a-b258-44e4cea202f2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:20:47.206637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7eec5f4a-efb1-404a-b258-44e4cea202f2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1655 microversion: 2.1 time: 0.194539 Jun 03 13:20:47.207389 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 463/933] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:20:47 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1655 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:47.228466 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4a1ccc8d-0940-4720-8278-8a1a354219e0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:20:47.235436 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a1ccc8d-0940-4720-8278-8a1a354219e0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:47.235893 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4a1ccc8d-0940-4720-8278-8a1a354219e0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:47.258949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4a1ccc8d-0940-4720-8278-8a1a354219e0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Going to try to start instance {{(pid=117727) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 13:20:47.314808 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4a1ccc8d-0940-4720-8278-8a1a354219e0 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "POST /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/action" status: 202 len: 0 microversion: 2.1 time: 0.089750 Jun 03 13:20:47.315728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 471/934] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:20:47 2022] POST /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:20:47.324165 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ec3a352b-14d3-422e-b668-9a1331529352 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:47.324765 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ec3a352b-14d3-422e-b668-9a1331529352 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:47.331159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec3a352b-14d3-422e-b668-9a1331529352 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:47.331668 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec3a352b-14d3-422e-b668-9a1331529352 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:47.332535 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec3a352b-14d3-422e-b668-9a1331529352 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:47.332970 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ec3a352b-14d3-422e-b668-9a1331529352 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:47.469996 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ec3a352b-14d3-422e-b668-9a1331529352 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:20:47.477958 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ec3a352b-14d3-422e-b668-9a1331529352 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1664 microversion: 2.1 time: 0.157714 Jun 03 13:20:47.478764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 464/935] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:20:47 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:48.500153 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-62fe8880-3f7c-4041-9168-1493674aef5d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:20:48.500908 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-62fe8880-3f7c-4041-9168-1493674aef5d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:20:48.509181 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-62fe8880-3f7c-4041-9168-1493674aef5d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:48.509632 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-62fe8880-3f7c-4041-9168-1493674aef5d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:48.510448 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-62fe8880-3f7c-4041-9168-1493674aef5d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:20:48.510884 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-62fe8880-3f7c-4041-9168-1493674aef5d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:20:48.651061 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-62fe8880-3f7c-4041-9168-1493674aef5d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:20:48.662804 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-62fe8880-3f7c-4041-9168-1493674aef5d tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1668 microversion: 2.1 time: 0.170294 Jun 03 13:20:48.663382 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 472/936] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:20:48 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:20:56.422581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:20:56.423289 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Fri Jun 3 13:20:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:21:37.326837 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-16827d5b-2edc-41ba-81d5-2bc4271f7d63 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:37.327773 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-16827d5b-2edc-41ba-81d5-2bc4271f7d63 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:37.330457 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=14 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:37.331772 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:37.337809 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-16827d5b-2edc-41ba-81d5-2bc4271f7d63 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:37.338283 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-16827d5b-2edc-41ba-81d5-2bc4271f7d63 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:37.339059 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-16827d5b-2edc-41ba-81d5-2bc4271f7d63 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:37.339489 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-16827d5b-2edc-41ba-81d5-2bc4271f7d63 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:37.371490 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-16827d5b-2edc-41ba-81d5-2bc4271f7d63 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048586 Jun 03 13:21:37.372051 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 465/937] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:21:37 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:21:37.441225 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c51d0620-c637-4815-9aea-ce88191daa57 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:37.441765 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c51d0620-c637-4815-9aea-ce88191daa57 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:37.443834 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=16 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:37.444492 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:37.450398 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c51d0620-c637-4815-9aea-ce88191daa57 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:37.450852 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c51d0620-c637-4815-9aea-ce88191daa57 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:37.451632 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c51d0620-c637-4815-9aea-ce88191daa57 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:37.452073 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c51d0620-c637-4815-9aea-ce88191daa57 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:37.479630 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c51d0620-c637-4815-9aea-ce88191daa57 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:21:37.565194 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c51d0620-c637-4815-9aea-ce88191daa57 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 204 len: 0 microversion: 2.1 time: 0.127285 Jun 03 13:21:37.565958 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 473/938] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:21:37 2022] DELETE /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:21:37.574332 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e4a41351-f87d-4834-b237-5a1f8ed94ba5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:37.574947 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e4a41351-f87d-4834-b237-5a1f8ed94ba5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:37.581266 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4a41351-f87d-4834-b237-5a1f8ed94ba5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:37.581718 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4a41351-f87d-4834-b237-5a1f8ed94ba5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:37.582542 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4a41351-f87d-4834-b237-5a1f8ed94ba5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:37.582966 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e4a41351-f87d-4834-b237-5a1f8ed94ba5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:37.726316 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e4a41351-f87d-4834-b237-5a1f8ed94ba5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:37.739039 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e4a41351-f87d-4834-b237-5a1f8ed94ba5 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1674 microversion: 2.1 time: 0.168389 Jun 03 13:21:37.740312 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 466/939] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:37 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:38.768187 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ebd46869-4a82-4eef-b4ec-7ad64083e7da tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:38.769178 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ebd46869-4a82-4eef-b4ec-7ad64083e7da tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:38.777227 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebd46869-4a82-4eef-b4ec-7ad64083e7da tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:38.777689 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebd46869-4a82-4eef-b4ec-7ad64083e7da tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:38.778502 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebd46869-4a82-4eef-b4ec-7ad64083e7da tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:38.778941 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ebd46869-4a82-4eef-b4ec-7ad64083e7da tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:38.920412 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ebd46869-4a82-4eef-b4ec-7ad64083e7da tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:38.932219 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ebd46869-4a82-4eef-b4ec-7ad64083e7da tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1674 microversion: 2.1 time: 0.171233 Jun 03 13:21:38.933036 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 474/940] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:38 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:39.953519 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-662b2636-dbeb-4cb1-876a-0a3e3087caaa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:39.954170 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-662b2636-dbeb-4cb1-876a-0a3e3087caaa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:39.961335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-662b2636-dbeb-4cb1-876a-0a3e3087caaa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:39.961791 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-662b2636-dbeb-4cb1-876a-0a3e3087caaa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:39.962598 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-662b2636-dbeb-4cb1-876a-0a3e3087caaa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:39.963035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-662b2636-dbeb-4cb1-876a-0a3e3087caaa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:40.095199 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-662b2636-dbeb-4cb1-876a-0a3e3087caaa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:40.103886 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-662b2636-dbeb-4cb1-876a-0a3e3087caaa tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1674 microversion: 2.1 time: 0.154745 Jun 03 13:21:40.104518 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 467/941] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:39 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:40.966406 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-6da773d9-dfc9-46da-9d87-09708240ff2d req-4ea50003-bd31-4e80-ac2c-f2037b3ff003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03cd556a-7089-4497-b35f-9124779bbe9d", "name": "network-vif-deleted", "tag": "8f66b934-4fb4-4e26-a706-64a3b5880265"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:40.980323 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-6da773d9-dfc9-46da-9d87-09708240ff2d req-4ea50003-bd31-4e80-ac2c-f2037b3ff003 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:40.980991 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-6da773d9-dfc9-46da-9d87-09708240ff2d req-4ea50003-bd31-4e80-ac2c-f2037b3ff003 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:40.994514 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-6da773d9-dfc9-46da-9d87-09708240ff2d req-4ea50003-bd31-4e80-ac2c-f2037b3ff003 service nova] Creating event network-vif-deleted:8f66b934-4fb4-4e26-a706-64a3b5880265 for instance 03cd556a-7089-4497-b35f-9124779bbe9d on hv-cinder-77954 Jun 03 13:21:41.001818 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-6da773d9-dfc9-46da-9d87-09708240ff2d req-4ea50003-bd31-4e80-ac2c-f2037b3ff003 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108177 Jun 03 13:21:41.002720 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 475/942] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:41.122166 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5a6709ff-c995-4c6c-b604-c742040f9836 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:41.122814 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5a6709ff-c995-4c6c-b604-c742040f9836 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:41.129539 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a6709ff-c995-4c6c-b604-c742040f9836 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:41.130373 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a6709ff-c995-4c6c-b604-c742040f9836 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:41.131168 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a6709ff-c995-4c6c-b604-c742040f9836 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:41.131606 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a6709ff-c995-4c6c-b604-c742040f9836 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:41.162319 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a6709ff-c995-4c6c-b604-c742040f9836 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:41.162923 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5a6709ff-c995-4c6c-b604-c742040f9836 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:41.163377 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-5a6709ff-c995-4c6c-b604-c742040f9836 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lazy-loading 'fault' on Instance uuid 03cd556a-7089-4497-b35f-9124779bbe9d {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:21:41.203943 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5a6709ff-c995-4c6c-b604-c742040f9836 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:41.211654 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5a6709ff-c995-4c6c-b604-c742040f9836 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 200 len: 1328 microversion: 2.1 time: 0.094345 Jun 03 13:21:41.212236 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 468/943] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:41 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:42.233729 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4edf9e24-bb78-46ea-8e26-6582037b7843 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:42.234926 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4edf9e24-bb78-46ea-8e26-6582037b7843 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:42.247431 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4edf9e24-bb78-46ea-8e26-6582037b7843 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:42.248205 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4edf9e24-bb78-46ea-8e26-6582037b7843 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:42.249491 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4edf9e24-bb78-46ea-8e26-6582037b7843 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:42.250274 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4edf9e24-bb78-46ea-8e26-6582037b7843 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:42.265275 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-4edf9e24-bb78-46ea-8e26-6582037b7843 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] HTTP exception thrown: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4edf9e24-bb78-46ea-8e26-6582037b7843 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Request method failure captured: Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d HTTP/1.1 Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgoFw6tFjV45lGeNNPONBd0VJY4G48DomoM8eEdtqYkMQ4_iF5JqE-OJHOE4xCSW_q6-6EueOSckmjtq0ROJ1rnPZwC3dXNhs3spmbw6mKpGccWI5dSw1uSVJlPCxRHuOWp988A_MdL7NyZJg3IRdR5_UAjDkb88UvDJZxML7EXUBUc Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 8c86bae74a9443368c08e697fd4a9048 Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:21:42.266944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:21:42.268543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8c86bae74a9443368c08e697fd4a9048"}]}] Jun 03 13:21:42.268543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:21:42.268543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 8c86bae74a9443368c08e697fd4a9048 Jun 03 13:21:42.268543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:21:42.268543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeTestJSON-207450514-project Jun 03 13:21:42.268543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:21:42.268543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:21:42.268543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 8742453c42ae4d9a8e4b996d628d5f90 Jun 03 13:21:42.268543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeTestJSON-207450514-project Jun 03 13:21:42.268543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:21:42.268543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:21:42.268543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '03cd556a-7089-4497-b35f-9124779bbe9d'} Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:21:42.269777 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:21:42.271422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:21:42.273072 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4edf9e24-bb78-46ea-8e26-6582037b7843 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Returning 404 to user: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:21:42.273072 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4edf9e24-bb78-46ea-8e26-6582037b7843 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 404 len: 111 microversion: 2.1 time: 0.042090 Jun 03 13:21:42.273072 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 476/944] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:42 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:21:42.277283 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a9bb032a-4ede-4de5-86d0-4be2c1b70687 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '.version_select at 0x7fc5a4e960d0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:42.297407 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a9bb032a-4ede-4de5-86d0-4be2c1b70687 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446833669" status: 202 len: 0 microversion: 2.1 time: 0.023959 Jun 03 13:21:42.297964 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 469/945] 10.222.0.58 () {58 vars in 1220 bytes} [Fri Jun 3 13:21:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446833669 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:21:42.944354 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ee44e048-6edb-4076-bdb2-939ff8ee155f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Action: 'create', calling method: .version_select at 0x7fc5a957baf0>, body: {"keypair": {"name": "tempest-keypair-1725970328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUFQF3asUE6SCYUbDCyZMsSWW0pYNWsAGJ1J2XY76k5nVfmUKIPpU2M3diUzQIoPysooX4a7u1YRdiDSH1ezhxRz9Sc1nscrmzMZlI340HsB18f6eIOwgZfsq/rodjHFQ=="}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:42.958677 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-ee44e048-6edb-4076-bdb2-939ff8ee155f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Getting quotas for project 8c86bae74a9443368c08e697fd4a9048. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:21:42.962622 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-ee44e048-6edb-4076-bdb2-939ff8ee155f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Getting quotas for user 8742453c42ae4d9a8e4b996d628d5f90 and project 8c86bae74a9443368c08e697fd4a9048. Resources: {'key_pairs'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:21:42.992533 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ee44e048-6edb-4076-bdb2-939ff8ee155f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052335 Jun 03 13:21:42.993162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 477/946] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Jun 3 13:21:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:44.287311 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1948063222", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12dd50c6-1515-4eb0-ac2d-a6103b95977b"}], "security_groups": [{"name": "tempest-securitygroup--469703677"}], "key_name": "tempest-keypair-1725970328", "user_data": "}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:44.406759 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] validate_networks() for [('12dd50c6-1515-4eb0-ac2d-a6103b95977b', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:21:44.864595 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:21:44.865384 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:21:44.865855 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:21:44.866298 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:21:44.866708 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:21:44.875858 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:44.876305 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:44.877107 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:44.877541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:44.894726 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Getting quotas for project 8c86bae74a9443368c08e697fd4a9048. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:21:44.899490 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Getting quotas for user 8742453c42ae4d9a8e4b996d628d5f90 and project 8c86bae74a9443368c08e697fd4a9048. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:21:44.911387 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:21:44.913666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:21:44.963864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-11386756-23c3-4bf2-b152-a16c0288c7bc tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.681554 Jun 03 13:21:44.964791 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 470/947] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:21:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:21:44.975633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-794ad0a2-ba90-4166-b273-06163d1923ae tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:44.976275 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-794ad0a2-ba90-4166-b273-06163d1923ae tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:45.035193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-794ad0a2-ba90-4166-b273-06163d1923ae tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:45.042795 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-794ad0a2-ba90-4166-b273-06163d1923ae tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1238 microversion: 2.1 time: 0.071790 Jun 03 13:21:45.043353 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 478/948] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:44 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:46.060445 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-57874d64-a89e-4a31-90ad-a5ffb9b368d3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:46.061013 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-57874d64-a89e-4a31-90ad-a5ffb9b368d3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:46.067343 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57874d64-a89e-4a31-90ad-a5ffb9b368d3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:46.067803 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57874d64-a89e-4a31-90ad-a5ffb9b368d3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:46.068679 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57874d64-a89e-4a31-90ad-a5ffb9b368d3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:46.069077 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57874d64-a89e-4a31-90ad-a5ffb9b368d3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:46.135661 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-57874d64-a89e-4a31-90ad-a5ffb9b368d3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:46.147262 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-57874d64-a89e-4a31-90ad-a5ffb9b368d3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1308 microversion: 2.1 time: 0.091120 Jun 03 13:21:46.147969 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 471/949] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:46 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:47.168177 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2c2feb1c-0a00-4d38-830a-46523ab8f59f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:47.169403 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2c2feb1c-0a00-4d38-830a-46523ab8f59f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:47.176946 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2c2feb1c-0a00-4d38-830a-46523ab8f59f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:47.177391 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2c2feb1c-0a00-4d38-830a-46523ab8f59f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:47.178267 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2c2feb1c-0a00-4d38-830a-46523ab8f59f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:47.178714 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2c2feb1c-0a00-4d38-830a-46523ab8f59f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:47.324559 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2c2feb1c-0a00-4d38-830a-46523ab8f59f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:47.334813 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2c2feb1c-0a00-4d38-830a-46523ab8f59f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1363 microversion: 2.1 time: 0.170743 Jun 03 13:21:47.335695 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 479/950] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:47 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:47.468816 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-f68eda41-e9f9-4d93-97db-a9a18a02969b req-2839e5e5-5840-4790-9e0c-204573a9c4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6715af-da25-4466-adcc-ab98f239c95b", "tag": "3307ee07-e1e8-4f83-95a1-4f44c5b545c0"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:47.499767 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-f68eda41-e9f9-4d93-97db-a9a18a02969b req-2839e5e5-5840-4790-9e0c-204573a9c4d0 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:47.500210 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-f68eda41-e9f9-4d93-97db-a9a18a02969b req-2839e5e5-5840-4790-9e0c-204573a9c4d0 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:47.517004 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-f68eda41-e9f9-4d93-97db-a9a18a02969b req-2839e5e5-5840-4790-9e0c-204573a9c4d0 service nova] Creating event network-changed:3307ee07-e1e8-4f83-95a1-4f44c5b545c0 for instance 1e6715af-da25-4466-adcc-ab98f239c95b on hv-cinder-77954 Jun 03 13:21:47.522813 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-f68eda41-e9f9-4d93-97db-a9a18a02969b req-2839e5e5-5840-4790-9e0c-204573a9c4d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060480 Jun 03 13:21:47.523578 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 472/951] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:48.356736 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-40c2eecf-0504-4b47-917f-204d97605cba tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:48.357756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-40c2eecf-0504-4b47-917f-204d97605cba tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:48.369809 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40c2eecf-0504-4b47-917f-204d97605cba tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:48.370607 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40c2eecf-0504-4b47-917f-204d97605cba tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:48.371883 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40c2eecf-0504-4b47-917f-204d97605cba tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:48.372591 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-40c2eecf-0504-4b47-917f-204d97605cba tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:48.514208 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-40c2eecf-0504-4b47-917f-204d97605cba tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:48.526313 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-40c2eecf-0504-4b47-917f-204d97605cba tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1363 microversion: 2.1 time: 0.175817 Jun 03 13:21:48.527130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 480/952] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:48 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:49.550173 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1c9dfda7-2318-4d81-a410-b81db30f3beb tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:49.551035 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1c9dfda7-2318-4d81-a410-b81db30f3beb tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:49.558610 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c9dfda7-2318-4d81-a410-b81db30f3beb tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:49.559057 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c9dfda7-2318-4d81-a410-b81db30f3beb tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:49.559827 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c9dfda7-2318-4d81-a410-b81db30f3beb tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:49.560264 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1c9dfda7-2318-4d81-a410-b81db30f3beb tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:49.703525 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1c9dfda7-2318-4d81-a410-b81db30f3beb tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:49.713543 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1c9dfda7-2318-4d81-a410-b81db30f3beb tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1363 microversion: 2.1 time: 0.169352 Jun 03 13:21:49.714191 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 473/953] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:49 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:50.731566 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-5fd6a03a-940b-47a9-9457-90e45f88dac1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:50.732198 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-5fd6a03a-940b-47a9-9457-90e45f88dac1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:50.738548 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fd6a03a-940b-47a9-9457-90e45f88dac1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:50.738999 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fd6a03a-940b-47a9-9457-90e45f88dac1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:50.740145 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fd6a03a-940b-47a9-9457-90e45f88dac1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:50.740567 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-5fd6a03a-940b-47a9-9457-90e45f88dac1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:50.884339 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-5fd6a03a-940b-47a9-9457-90e45f88dac1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:50.896076 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5fd6a03a-940b-47a9-9457-90e45f88dac1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1363 microversion: 2.1 time: 0.168345 Jun 03 13:21:50.896891 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 481/954] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:50 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:51.918047 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-86a5c89f-a92a-45ee-82f2-a9826592f006 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:51.918732 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-86a5c89f-a92a-45ee-82f2-a9826592f006 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:51.928129 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86a5c89f-a92a-45ee-82f2-a9826592f006 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:51.928644 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86a5c89f-a92a-45ee-82f2-a9826592f006 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:51.929939 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86a5c89f-a92a-45ee-82f2-a9826592f006 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:51.930486 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-86a5c89f-a92a-45ee-82f2-a9826592f006 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:52.073210 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-86a5c89f-a92a-45ee-82f2-a9826592f006 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:52.084293 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-86a5c89f-a92a-45ee-82f2-a9826592f006 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1363 microversion: 2.1 time: 0.173122 Jun 03 13:21:52.084983 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 474/955] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:51 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:53.106391 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1458e343-24d1-49d6-af9b-f5032d64fc0b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:53.107026 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1458e343-24d1-49d6-af9b-f5032d64fc0b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:53.113644 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1458e343-24d1-49d6-af9b-f5032d64fc0b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:53.115848 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1458e343-24d1-49d6-af9b-f5032d64fc0b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:53.116640 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1458e343-24d1-49d6-af9b-f5032d64fc0b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:53.117204 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1458e343-24d1-49d6-af9b-f5032d64fc0b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:53.252158 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1458e343-24d1-49d6-af9b-f5032d64fc0b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:53.259942 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1458e343-24d1-49d6-af9b-f5032d64fc0b tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1363 microversion: 2.1 time: 0.157523 Jun 03 13:21:53.260726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 482/956] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:53 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:53.275763 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-11ba875d-9433-478b-8e2f-211896c3c698 req-383f9376-1393-4a98-9460-e783dc4bd1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6715af-da25-4466-adcc-ab98f239c95b", "name": "network-vif-plugged", "status": "completed", "tag": "3307ee07-e1e8-4f83-95a1-4f44c5b545c0"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:53.283854 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-11ba875d-9433-478b-8e2f-211896c3c698 req-383f9376-1393-4a98-9460-e783dc4bd1d3 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:53.284293 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-11ba875d-9433-478b-8e2f-211896c3c698 req-383f9376-1393-4a98-9460-e783dc4bd1d3 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:53.295422 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-11ba875d-9433-478b-8e2f-211896c3c698 req-383f9376-1393-4a98-9460-e783dc4bd1d3 service nova] Creating event network-vif-plugged:3307ee07-e1e8-4f83-95a1-4f44c5b545c0 for instance 1e6715af-da25-4466-adcc-ab98f239c95b on hv-cinder-77954 Jun 03 13:21:53.300427 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-11ba875d-9433-478b-8e2f-211896c3c698 req-383f9376-1393-4a98-9460-e783dc4bd1d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098865 Jun 03 13:21:53.301092 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 475/957] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:54.280906 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7649cb9f-ee07-43d4-8251-2e92a36467a8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:54.281853 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7649cb9f-ee07-43d4-8251-2e92a36467a8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:54.291317 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7649cb9f-ee07-43d4-8251-2e92a36467a8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:54.291773 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7649cb9f-ee07-43d4-8251-2e92a36467a8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:54.292551 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7649cb9f-ee07-43d4-8251-2e92a36467a8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:54.292988 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7649cb9f-ee07-43d4-8251-2e92a36467a8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:54.429955 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7649cb9f-ee07-43d4-8251-2e92a36467a8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:54.438022 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7649cb9f-ee07-43d4-8251-2e92a36467a8 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1363 microversion: 2.1 time: 0.163660 Jun 03 13:21:54.438636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 483/958] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:54 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:55.454034 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:55.454869 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:55.459646 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4f0fc056-6953-432a-89e5-49e15c22faf2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:55.460566 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4f0fc056-6953-432a-89e5-49e15c22faf2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:55.468367 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f0fc056-6953-432a-89e5-49e15c22faf2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:55.468814 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f0fc056-6953-432a-89e5-49e15c22faf2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:55.469602 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f0fc056-6953-432a-89e5-49e15c22faf2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:55.470042 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4f0fc056-6953-432a-89e5-49e15c22faf2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:55.604784 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4f0fc056-6953-432a-89e5-49e15c22faf2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:21:55.612637 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4f0fc056-6953-432a-89e5-49e15c22faf2 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1547 microversion: 2.1 time: 0.160048 Jun 03 13:21:55.613184 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 476/959] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:21:55 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:21:55.629360 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-75f74a35-8ef7-4037-9f5a-969618d58f29 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:21:55.629878 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-75f74a35-8ef7-4037-9f5a-969618d58f29 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:21:55.631857 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:21:55.638057 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75f74a35-8ef7-4037-9f5a-969618d58f29 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:55.638536 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75f74a35-8ef7-4037-9f5a-969618d58f29 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:55.639312 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75f74a35-8ef7-4037-9f5a-969618d58f29 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:55.639729 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-75f74a35-8ef7-4037-9f5a-969618d58f29 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:55.726592 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-75f74a35-8ef7-4037-9f5a-969618d58f29 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100793 Jun 03 13:21:55.727153 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 484/960] 10.222.0.58 () {58 vars in 1274 bytes} [Fri Jun 3 13:21:55 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:21:56.722845 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-ea12798f-5be0-4091-a150-7e57f9176f1c req-6d041624-70ff-4a09-a642-cebd9b0cc9da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6715af-da25-4466-adcc-ab98f239c95b", "tag": "3307ee07-e1e8-4f83-95a1-4f44c5b545c0"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:21:56.731077 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-ea12798f-5be0-4091-a150-7e57f9176f1c req-6d041624-70ff-4a09-a642-cebd9b0cc9da service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:21:56.731534 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-ea12798f-5be0-4091-a150-7e57f9176f1c req-6d041624-70ff-4a09-a642-cebd9b0cc9da service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:21:56.743147 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-ea12798f-5be0-4091-a150-7e57f9176f1c req-6d041624-70ff-4a09-a642-cebd9b0cc9da service nova] Creating event network-changed:3307ee07-e1e8-4f83-95a1-4f44c5b545c0 for instance 1e6715af-da25-4466-adcc-ab98f239c95b on hv-cinder-77954 Jun 03 13:21:56.748555 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-ea12798f-5be0-4091-a150-7e57f9176f1c req-6d041624-70ff-4a09-a642-cebd9b0cc9da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084638 Jun 03 13:21:56.749405 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 477/961] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:01.307417 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:01.308685 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:01.363766 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7f7b5f83-2c55-49d9-aaad-eaa862cdfa22 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:01.364289 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7f7b5f83-2c55-49d9-aaad-eaa862cdfa22 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:01.371090 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f7b5f83-2c55-49d9-aaad-eaa862cdfa22 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:01.371538 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f7b5f83-2c55-49d9-aaad-eaa862cdfa22 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:01.372310 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f7b5f83-2c55-49d9-aaad-eaa862cdfa22 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:01.372751 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7f7b5f83-2c55-49d9-aaad-eaa862cdfa22 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:01.395878 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7f7b5f83-2c55-49d9-aaad-eaa862cdfa22 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/ips" status: 200 len: 143 microversion: 2.1 time: 0.091773 Jun 03 13:23:01.396424 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 485/962] 10.222.0.58 () {58 vars in 1247 bytes} [Fri Jun 3 13:23:01 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/ips => generated 143 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:23:02.732422 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:02.733138 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=58 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:02.738413 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-677f0978-40b6-4a0d-872a-3927744b0e03 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c589ee8-cf9d-4de2-8af0-6f5b05a440f1"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:23:02.739596 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-677f0978-40b6-4a0d-872a-3927744b0e03 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:02.747884 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-677f0978-40b6-4a0d-872a-3927744b0e03 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:02.748421 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-677f0978-40b6-4a0d-872a-3927744b0e03 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:02.749229 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-677f0978-40b6-4a0d-872a-3927744b0e03 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:02.749661 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-677f0978-40b6-4a0d-872a-3927744b0e03 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:03.145323 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-677f0978-40b6-4a0d-872a-3927744b0e03 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "POST /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414572 Jun 03 13:23:03.145893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 478/963] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:23:02 2022] POST /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:10.696971 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bf3935bd-9348-439d-b9bc-ac99951469ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:10.697959 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bf3935bd-9348-439d-b9bc-ac99951469ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:10.704739 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf3935bd-9348-439d-b9bc-ac99951469ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:10.705194 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf3935bd-9348-439d-b9bc-ac99951469ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:10.705969 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf3935bd-9348-439d-b9bc-ac99951469ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:10.706413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bf3935bd-9348-439d-b9bc-ac99951469ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:10.744073 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bf3935bd-9348-439d-b9bc-ac99951469ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051169 Jun 03 13:23:10.744811 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 486/964] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:23:10 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:10.759542 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8ae57f30-d75a-47a9-9331-cc1e690eeb50 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:10.760092 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8ae57f30-d75a-47a9-9331-cc1e690eeb50 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:10.766837 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ae57f30-d75a-47a9-9331-cc1e690eeb50 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:10.767286 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ae57f30-d75a-47a9-9331-cc1e690eeb50 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:10.768055 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ae57f30-d75a-47a9-9331-cc1e690eeb50 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:10.768488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8ae57f30-d75a-47a9-9331-cc1e690eeb50 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:10.797619 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8ae57f30-d75a-47a9-9331-cc1e690eeb50 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments/1c589ee8-cf9d-4de2-8af0-6f5b05a440f1" status: 200 len: 194 microversion: 2.1 time: 0.043890 Jun 03 13:23:10.798221 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 479/965] 10.222.0.58 () {58 vars in 1412 bytes} [Fri Jun 3 13:23:10 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments/1c589ee8-cf9d-4de2-8af0-6f5b05a440f1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:12.158720 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0066cd4a-a9a3-44f8-8199-7996b1122050 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53fcaac6-a2e9-41ca-86b9-4eafc11cf8b3"}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:23:12.160396 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0066cd4a-a9a3-44f8-8199-7996b1122050 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:12.170647 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0066cd4a-a9a3-44f8-8199-7996b1122050 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:12.171384 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0066cd4a-a9a3-44f8-8199-7996b1122050 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:12.172468 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0066cd4a-a9a3-44f8-8199-7996b1122050 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:12.173122 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0066cd4a-a9a3-44f8-8199-7996b1122050 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:12.498262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0066cd4a-a9a3-44f8-8199-7996b1122050 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "POST /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346045 Jun 03 13:23:12.498876 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 487/966] 10.222.0.58 () {60 vars in 1322 bytes} [Fri Jun 3 13:23:12 2022] POST /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:20.071343 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3a2610d5-5772-43ea-b1d8-19856c09c875 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:20.072656 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3a2610d5-5772-43ea-b1d8-19856c09c875 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:20.082725 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a2610d5-5772-43ea-b1d8-19856c09c875 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:20.083314 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a2610d5-5772-43ea-b1d8-19856c09c875 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:20.084456 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a2610d5-5772-43ea-b1d8-19856c09c875 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:20.085025 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3a2610d5-5772-43ea-b1d8-19856c09c875 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:20.124691 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3a2610d5-5772-43ea-b1d8-19856c09c875 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.059124 Jun 03 13:23:20.125987 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 480/967] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:23:20 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:20.271993 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-8a440352-f18a-4252-a26d-c498fd6b227c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:20.272555 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-8a440352-f18a-4252-a26d-c498fd6b227c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:20.279427 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a440352-f18a-4252-a26d-c498fd6b227c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:20.279878 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a440352-f18a-4252-a26d-c498fd6b227c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:20.280666 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a440352-f18a-4252-a26d-c498fd6b227c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:20.281110 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-8a440352-f18a-4252-a26d-c498fd6b227c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:20.312768 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-8a440352-f18a-4252-a26d-c498fd6b227c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments/1c589ee8-cf9d-4de2-8af0-6f5b05a440f1" status: 200 len: 194 microversion: 2.1 time: 0.045669 Jun 03 13:23:20.313414 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 488/968] 10.222.0.58 () {58 vars in 1412 bytes} [Fri Jun 3 13:23:20 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments/1c589ee8-cf9d-4de2-8af0-6f5b05a440f1 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:20.323690 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e55f87a4-1587-4f7b-af6e-2c31b681f3a1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:20.324182 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e55f87a4-1587-4f7b-af6e-2c31b681f3a1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:20.330681 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e55f87a4-1587-4f7b-af6e-2c31b681f3a1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:20.331115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e55f87a4-1587-4f7b-af6e-2c31b681f3a1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:20.331880 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e55f87a4-1587-4f7b-af6e-2c31b681f3a1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:20.332307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e55f87a4-1587-4f7b-af6e-2c31b681f3a1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:20.421015 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-e55f87a4-1587-4f7b-af6e-2c31b681f3a1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lazy-loading 'services' on Instance uuid 1e6715af-da25-4466-adcc-ab98f239c95b {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:23:20.513530 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e55f87a4-1587-4f7b-af6e-2c31b681f3a1 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments/1c589ee8-cf9d-4de2-8af0-6f5b05a440f1" status: 202 len: 0 microversion: 2.1 time: 0.193787 Jun 03 13:23:20.514131 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 481/969] 10.222.0.58 () {58 vars in 1415 bytes} [Fri Jun 3 13:23:20 2022] DELETE /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments/1c589ee8-cf9d-4de2-8af0-6f5b05a440f1 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:23:21.633433 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0b6af085-de6c-4aca-a177-380ba1d2c4ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:21.634052 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0b6af085-de6c-4aca-a177-380ba1d2c4ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:21.641022 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b6af085-de6c-4aca-a177-380ba1d2c4ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:21.641468 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b6af085-de6c-4aca-a177-380ba1d2c4ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:21.642266 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b6af085-de6c-4aca-a177-380ba1d2c4ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:21.642705 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0b6af085-de6c-4aca-a177-380ba1d2c4ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:21.673319 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0b6af085-de6c-4aca-a177-380ba1d2c4ec tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments/53fcaac6-a2e9-41ca-86b9-4eafc11cf8b3" status: 200 len: 194 microversion: 2.1 time: 0.043995 Jun 03 13:23:21.673884 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 489/970] 10.222.0.58 () {58 vars in 1412 bytes} [Fri Jun 3 13:23:21 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments/53fcaac6-a2e9-41ca-86b9-4eafc11cf8b3 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:21.686043 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-3c71d5ec-4dc2-4092-b232-129e96f69c34 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:21.686731 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-3c71d5ec-4dc2-4092-b232-129e96f69c34 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:21.693381 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c71d5ec-4dc2-4092-b232-129e96f69c34 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:21.693833 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c71d5ec-4dc2-4092-b232-129e96f69c34 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:21.694640 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c71d5ec-4dc2-4092-b232-129e96f69c34 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:21.695082 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-3c71d5ec-4dc2-4092-b232-129e96f69c34 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:21.787259 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-3c71d5ec-4dc2-4092-b232-129e96f69c34 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lazy-loading 'services' on Instance uuid 1e6715af-da25-4466-adcc-ab98f239c95b {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:23:21.872353 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-3c71d5ec-4dc2-4092-b232-129e96f69c34 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments/53fcaac6-a2e9-41ca-86b9-4eafc11cf8b3" status: 202 len: 0 microversion: 2.1 time: 0.191606 Jun 03 13:23:21.872955 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 482/971] 10.222.0.58 () {58 vars in 1415 bytes} [Fri Jun 3 13:23:21 2022] DELETE /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments/53fcaac6-a2e9-41ca-86b9-4eafc11cf8b3 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:23:23.044588 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-61cd7616-4167-4021-9802-1817cbf5ef1a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:23.045588 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-61cd7616-4167-4021-9802-1817cbf5ef1a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:23.052847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-61cd7616-4167-4021-9802-1817cbf5ef1a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.053300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-61cd7616-4167-4021-9802-1817cbf5ef1a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.054082 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-61cd7616-4167-4021-9802-1817cbf5ef1a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.054563 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-61cd7616-4167-4021-9802-1817cbf5ef1a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.083634 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-61cd7616-4167-4021-9802-1817cbf5ef1a tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043263 Jun 03 13:23:23.084178 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 490/972] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:23:23 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:23:23.195238 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-a88b62e9-9871-48c3-981b-ae2c5eea9d40 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:23.196455 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-a88b62e9-9871-48c3-981b-ae2c5eea9d40 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:23.205919 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a88b62e9-9871-48c3-981b-ae2c5eea9d40 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.206561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a88b62e9-9871-48c3-981b-ae2c5eea9d40 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.207745 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a88b62e9-9871-48c3-981b-ae2c5eea9d40 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.208370 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-a88b62e9-9871-48c3-981b-ae2c5eea9d40 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.240405 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-a88b62e9-9871-48c3-981b-ae2c5eea9d40 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052993 Jun 03 13:23:23.241289 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 483/973] 10.222.0.58 () {58 vars in 1301 bytes} [Fri Jun 3 13:23:23 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 13:23:23.302297 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-30a8bf1e-0446-4af2-987e-455c0267763f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:23.302771 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-30a8bf1e-0446-4af2-987e-455c0267763f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:23.309137 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30a8bf1e-0446-4af2-987e-455c0267763f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.309592 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30a8bf1e-0446-4af2-987e-455c0267763f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.310429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30a8bf1e-0446-4af2-987e-455c0267763f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.310870 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-30a8bf1e-0446-4af2-987e-455c0267763f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.336437 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-30a8bf1e-0446-4af2-987e-455c0267763f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:23:23.418922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-30a8bf1e-0446-4af2-987e-455c0267763f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 204 len: 0 microversion: 2.1 time: 0.120174 Jun 03 13:23:23.419605 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 491/974] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:23:23 2022] DELETE /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:23:23.428463 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-10bea536-0c60-453e-9f83-b8a2da6efdf7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:23.429081 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-10bea536-0c60-453e-9f83-b8a2da6efdf7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:23.435760 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-10bea536-0c60-453e-9f83-b8a2da6efdf7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.436212 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-10bea536-0c60-453e-9f83-b8a2da6efdf7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.437006 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-10bea536-0c60-453e-9f83-b8a2da6efdf7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:23.437439 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-10bea536-0c60-453e-9f83-b8a2da6efdf7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:23.572696 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-10bea536-0c60-453e-9f83-b8a2da6efdf7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:23.580661 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-10bea536-0c60-453e-9f83-b8a2da6efdf7 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1671 microversion: 2.1 time: 0.156163 Jun 03 13:23:23.581501 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 484/975] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:23 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:23:24.604416 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-4aa417ac-15c5-414f-89ee-07bb590ff810 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:24.605626 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-4aa417ac-15c5-414f-89ee-07bb590ff810 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:24.617220 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4aa417ac-15c5-414f-89ee-07bb590ff810 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:24.618004 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4aa417ac-15c5-414f-89ee-07bb590ff810 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:24.619200 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4aa417ac-15c5-414f-89ee-07bb590ff810 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:24.619651 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-4aa417ac-15c5-414f-89ee-07bb590ff810 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:24.763211 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-4aa417ac-15c5-414f-89ee-07bb590ff810 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:24.771511 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-4aa417ac-15c5-414f-89ee-07bb590ff810 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1671 microversion: 2.1 time: 0.175190 Jun 03 13:23:24.772087 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 492/976] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:24 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1671 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:25.789109 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1748608f-dddd-41db-be71-a3c2ba3cb55c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:25.789699 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1748608f-dddd-41db-be71-a3c2ba3cb55c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:25.796789 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1748608f-dddd-41db-be71-a3c2ba3cb55c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:25.797241 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1748608f-dddd-41db-be71-a3c2ba3cb55c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:25.798025 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1748608f-dddd-41db-be71-a3c2ba3cb55c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:25.798499 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1748608f-dddd-41db-be71-a3c2ba3cb55c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:25.936656 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1748608f-dddd-41db-be71-a3c2ba3cb55c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742453c42ae4d9a8e4b996d628d5f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c86bae74a9443368c08e697fd4a9048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:25.944229 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1748608f-dddd-41db-be71-a3c2ba3cb55c tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 200 len: 1671 microversion: 2.1 time: 0.159196 Jun 03 13:23:25.944844 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 485/977] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:25 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:26.307895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-38105c49-218c-4683-8c76-02b30c8fb8eb req-c66a40b6-62d0-4f71-aafa-d28d6912b3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6715af-da25-4466-adcc-ab98f239c95b", "name": "network-vif-deleted", "tag": "3307ee07-e1e8-4f83-95a1-4f44c5b545c0"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:23:26.318931 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-38105c49-218c-4683-8c76-02b30c8fb8eb req-c66a40b6-62d0-4f71-aafa-d28d6912b3f2 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:26.319390 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-38105c49-218c-4683-8c76-02b30c8fb8eb req-c66a40b6-62d0-4f71-aafa-d28d6912b3f2 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:26.332014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-38105c49-218c-4683-8c76-02b30c8fb8eb req-c66a40b6-62d0-4f71-aafa-d28d6912b3f2 service nova] Creating event network-vif-deleted:3307ee07-e1e8-4f83-95a1-4f44c5b545c0 for instance 1e6715af-da25-4466-adcc-ab98f239c95b on hv-cinder-77954 Jun 03 13:23:26.337597 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-38105c49-218c-4683-8c76-02b30c8fb8eb req-c66a40b6-62d0-4f71-aafa-d28d6912b3f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033499 Jun 03 13:23:26.338464 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 493/978] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:23:26.973538 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d9159cc3-c834-450a-9496-b2b0a25f9343 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:26.974175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d9159cc3-c834-450a-9496-b2b0a25f9343 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:26.980849 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9159cc3-c834-450a-9496-b2b0a25f9343 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:26.981307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9159cc3-c834-450a-9496-b2b0a25f9343 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:26.982069 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9159cc3-c834-450a-9496-b2b0a25f9343 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:26.982528 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d9159cc3-c834-450a-9496-b2b0a25f9343 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:26.997312 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-d9159cc3-c834-450a-9496-b2b0a25f9343 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] HTTP exception thrown: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d9159cc3-c834-450a-9496-b2b0a25f9343 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Request method failure captured: Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b HTTP/1.1 Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgoFw6tFjV45lGeNNPONBd0VJY4G48DomoM8eEdtqYkMQ4_iF5JqE-OJHOE4xCSW_q6-6EueOSckmjtq0ROJ1rnPZwC3dXNhs3spmbw6mKpGccWI5dSw1uSVJlPCxRHuOWp988A_MdL7NyZJg3IRdR5_UAjDkb88UvDJZxML7EXUBUc Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 8c86bae74a9443368c08e697fd4a9048 Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:23:26.998995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:23:27.000703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8c86bae74a9443368c08e697fd4a9048"}]}] Jun 03 13:23:27.000703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:27.000703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 8c86bae74a9443368c08e697fd4a9048 Jun 03 13:23:27.000703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:27.000703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeTestJSON-207450514-project Jun 03 13:23:27.000703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:23:27.000703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:23:27.000703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 8742453c42ae4d9a8e4b996d628d5f90 Jun 03 13:23:27.000703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeTestJSON-207450514-project Jun 03 13:23:27.000703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:23:27.000703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:27.000703 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '1e6715af-da25-4466-adcc-ab98f239c95b'} Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:27.001611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:27.003140 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:27.004618 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d9159cc3-c834-450a-9496-b2b0a25f9343 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Returning 404 to user: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:27.004618 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d9159cc3-c834-450a-9496-b2b0a25f9343 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 404 len: 111 microversion: 2.1 time: 0.031345 Jun 03 13:23:27.004618 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 486/979] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:26 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:23:27.010340 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a6c41278-7a31-46be-bb20-cf21d7035e8f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '.version_select at 0x7fc5a4663310>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:27.029806 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a6c41278-7a31-46be-bb20-cf21d7035e8f tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725970328" status: 202 len: 0 microversion: 2.1 time: 0.023752 Jun 03 13:23:27.030422 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 494/980] 10.222.0.58 () {58 vars in 1220 bytes} [Fri Jun 3 13:23:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1725970328 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:23:29.972846 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-af4a7282-00df-4695-b24f-ba973bd88ff3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:29.973371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-af4a7282-00df-4695-b24f-ba973bd88ff3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:29.980318 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af4a7282-00df-4695-b24f-ba973bd88ff3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:29.980763 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af4a7282-00df-4695-b24f-ba973bd88ff3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:29.981522 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af4a7282-00df-4695-b24f-ba973bd88ff3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:29.981943 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-af4a7282-00df-4695-b24f-ba973bd88ff3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:29.998055 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-af4a7282-00df-4695-b24f-ba973bd88ff3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] HTTP exception thrown: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-af4a7282-00df-4695-b24f-ba973bd88ff3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Request method failure captured: Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: DELETE /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b HTTP/1.1 Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgoFw6tFjV45lGeNNPONBd0VJY4G48DomoM8eEdtqYkMQ4_iF5JqE-OJHOE4xCSW_q6-6EueOSckmjtq0ROJ1rnPZwC3dXNhs3spmbw6mKpGccWI5dSw1uSVJlPCxRHuOWp988A_MdL7NyZJg3IRdR5_UAjDkb88UvDJZxML7EXUBUc Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 8c86bae74a9443368c08e697fd4a9048 Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:23:29.999658 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:23:30.001198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8c86bae74a9443368c08e697fd4a9048"}]}] Jun 03 13:23:30.001198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:30.001198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 8c86bae74a9443368c08e697fd4a9048 Jun 03 13:23:30.001198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:30.001198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeTestJSON-207450514-project Jun 03 13:23:30.001198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:23:30.001198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:23:30.001198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 8742453c42ae4d9a8e4b996d628d5f90 Jun 03 13:23:30.001198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeTestJSON-207450514-project Jun 03 13:23:30.001198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:23:30.001198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:30.001198 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '1e6715af-da25-4466-adcc-ab98f239c95b'} Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:30.002037 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:30.003335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:30.004598 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-af4a7282-00df-4695-b24f-ba973bd88ff3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Returning 404 to user: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:30.004598 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-af4a7282-00df-4695-b24f-ba973bd88ff3 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 404 len: 111 microversion: 2.1 time: 0.032065 Jun 03 13:23:30.004598 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 487/981] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:23:29 2022] DELETE /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:23:30.013141 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-47040aba-f9e0-4dd6-b5cc-4618f5858f88 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:30.013998 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-47040aba-f9e0-4dd6-b5cc-4618f5858f88 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 1e6715af-da25-4466-adcc-ab98f239c95b] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:30.023514 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-47040aba-f9e0-4dd6-b5cc-4618f5858f88 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:30.024111 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-47040aba-f9e0-4dd6-b5cc-4618f5858f88 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:30.025642 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-47040aba-f9e0-4dd6-b5cc-4618f5858f88 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:30.025791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-47040aba-f9e0-4dd6-b5cc-4618f5858f88 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:30.040278 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-47040aba-f9e0-4dd6-b5cc-4618f5858f88 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] HTTP exception thrown: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-47040aba-f9e0-4dd6-b5cc-4618f5858f88 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Request method failure captured: Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b HTTP/1.1 Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgoFw6tFjV45lGeNNPONBd0VJY4G48DomoM8eEdtqYkMQ4_iF5JqE-OJHOE4xCSW_q6-6EueOSckmjtq0ROJ1rnPZwC3dXNhs3spmbw6mKpGccWI5dSw1uSVJlPCxRHuOWp988A_MdL7NyZJg3IRdR5_UAjDkb88UvDJZxML7EXUBUc Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 8c86bae74a9443368c08e697fd4a9048 Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:23:30.041939 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:23:30.043653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8c86bae74a9443368c08e697fd4a9048"}]}] Jun 03 13:23:30.043653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:30.043653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 8c86bae74a9443368c08e697fd4a9048 Jun 03 13:23:30.043653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:30.043653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeTestJSON-207450514-project Jun 03 13:23:30.043653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:23:30.043653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:23:30.043653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 8742453c42ae4d9a8e4b996d628d5f90 Jun 03 13:23:30.043653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeTestJSON-207450514-project Jun 03 13:23:30.043653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:23:30.043653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:30.043653 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '1e6715af-da25-4466-adcc-ab98f239c95b'} Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:30.044456 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. Jun 03 13:23:30.045756 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:30.046981 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-47040aba-f9e0-4dd6-b5cc-4618f5858f88 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Returning 404 to user: Instance 1e6715af-da25-4466-adcc-ab98f239c95b could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:30.046981 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-47040aba-f9e0-4dd6-b5cc-4618f5858f88 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b" status: 404 len: 111 microversion: 2.1 time: 0.037307 Jun 03 13:23:30.046981 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 495/982] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:30 2022] GET /compute/v2.1/servers/1e6715af-da25-4466-adcc-ab98f239c95b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:23:31.194784 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-57a9dd56-cbce-4f0e-ad0f-d55098b0823e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:31.195303 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-57a9dd56-cbce-4f0e-ad0f-d55098b0823e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:31.202330 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57a9dd56-cbce-4f0e-ad0f-d55098b0823e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:31.202781 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57a9dd56-cbce-4f0e-ad0f-d55098b0823e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:31.203558 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57a9dd56-cbce-4f0e-ad0f-d55098b0823e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:31.203995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-57a9dd56-cbce-4f0e-ad0f-d55098b0823e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:31.217991 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-57a9dd56-cbce-4f0e-ad0f-d55098b0823e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] HTTP exception thrown: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-57a9dd56-cbce-4f0e-ad0f-d55098b0823e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Request method failure captured: Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: DELETE /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d HTTP/1.1 Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgoFw6tFjV45lGeNNPONBd0VJY4G48DomoM8eEdtqYkMQ4_iF5JqE-OJHOE4xCSW_q6-6EueOSckmjtq0ROJ1rnPZwC3dXNhs3spmbw6mKpGccWI5dSw1uSVJlPCxRHuOWp988A_MdL7NyZJg3IRdR5_UAjDkb88UvDJZxML7EXUBUc Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: 8c86bae74a9443368c08e697fd4a9048 Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:23:31.219574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:23:31.221187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8c86bae74a9443368c08e697fd4a9048"}]}] Jun 03 13:23:31.221187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:31.221187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: 8c86bae74a9443368c08e697fd4a9048 Jun 03 13:23:31.221187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:31.221187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-AttachVolumeTestJSON-207450514-project Jun 03 13:23:31.221187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:23:31.221187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:23:31.221187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 8742453c42ae4d9a8e4b996d628d5f90 Jun 03 13:23:31.221187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-AttachVolumeTestJSON-207450514-project Jun 03 13:23:31.221187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:23:31.221187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:23:31.221187 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '03cd556a-7089-4497-b35f-9124779bbe9d'} Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:31.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:23:31.224307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:31.226020 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-57a9dd56-cbce-4f0e-ad0f-d55098b0823e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Returning 404 to user: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:31.226020 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-57a9dd56-cbce-4f0e-ad0f-d55098b0823e tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 404 len: 111 microversion: 2.1 time: 0.030201 Jun 03 13:23:31.226020 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 488/983] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:23:31 2022] DELETE /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:23:31.229523 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-626d9bea-4403-4165-b3c7-f36b9b949261 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:31.230236 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-626d9bea-4403-4165-b3c7-f36b9b949261 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] [instance: 03cd556a-7089-4497-b35f-9124779bbe9d] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:31.237002 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-626d9bea-4403-4165-b3c7-f36b9b949261 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:31.237457 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-626d9bea-4403-4165-b3c7-f36b9b949261 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:31.238238 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-626d9bea-4403-4165-b3c7-f36b9b949261 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:31.238864 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-626d9bea-4403-4165-b3c7-f36b9b949261 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:31.252817 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-626d9bea-4403-4165-b3c7-f36b9b949261 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] HTTP exception thrown: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-626d9bea-4403-4165-b3c7-f36b9b949261 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Request method failure captured: Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d HTTP/1.1 Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgoFw6tFjV45lGeNNPONBd0VJY4G48DomoM8eEdtqYkMQ4_iF5JqE-OJHOE4xCSW_q6-6EueOSckmjtq0ROJ1rnPZwC3dXNhs3spmbw6mKpGccWI5dSw1uSVJlPCxRHuOWp988A_MdL7NyZJg3IRdR5_UAjDkb88UvDJZxML7EXUBUc Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: 8c86bae74a9443368c08e697fd4a9048 Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:23:31.254386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:23:31.256014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8c86bae74a9443368c08e697fd4a9048"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8c86bae74a9443368c08e697fd4a9048"}]}] Jun 03 13:23:31.256014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:31.256014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: 8c86bae74a9443368c08e697fd4a9048 Jun 03 13:23:31.256014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-207450514 Jun 03 13:23:31.256014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-AttachVolumeTestJSON-207450514-project Jun 03 13:23:31.256014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:23:31.256014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:23:31.256014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 8742453c42ae4d9a8e4b996d628d5f90 Jun 03 13:23:31.256014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-AttachVolumeTestJSON-207450514-project Jun 03 13:23:31.256014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:23:31.256014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:23:31.256014 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '03cd556a-7089-4497-b35f-9124779bbe9d'} Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:31.256962 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. Jun 03 13:23:31.258543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:31.259922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-626d9bea-4403-4165-b3c7-f36b9b949261 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] Returning 404 to user: Instance 03cd556a-7089-4497-b35f-9124779bbe9d could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:31.259922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-626d9bea-4403-4165-b3c7-f36b9b949261 tempest-AttachVolumeTestJSON-207450514 tempest-AttachVolumeTestJSON-207450514-project] 10.222.0.58 "GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d" status: 404 len: 111 microversion: 2.1 time: 0.030051 Jun 03 13:23:31.259922 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 496/984] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:31 2022] GET /compute/v2.1/servers/03cd556a-7089-4497-b35f-9124779bbe9d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 13:23:35.669725 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8a64a0f6-f240-450f-8e67-a3589ec94880 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Action: 'create', calling method: .version_select at 0x7fc5a4ccd9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1612181083", "metadata": {"Type": "work"}}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8a64a0f6-f240-450f-8e67-a3589ec94880 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Request method failure captured: Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 122 Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgtXZCkHnb8_mJ-pbl2tIpGLom1whEEYR3x3upOyC9jEcC25epc__bz8gTUitCdx_hVxplElHYsF8Zp9Oxl3_A1H3FkDHxmwYdkcu1dA-faLfpc0m8GbkhKpFTOXiQIQBjPNAl1v3KP4f6f_jRbWEQK6HnpSuXjqE52dLXMdx47vTDc Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: a03d9ba6ec06469988d61a01396e520b Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:23:35.679115 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a03d9ba6ec06469988d61a01396e520b"}]}] Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: a03d9ba6ec06469988d61a01396e520b Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesNegativeTest-282441565-project Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: a09f0d946a0b4bc482a823a64acb7051 Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesNegativeTest-282441565-project Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1612181083", "metadata": {"Type": "work"}}} Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: Jun 03 13:23:35.680612 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1612181083', 'metadata': {'Type': 'work'}}}} Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise error Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi '#$%' Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:35.681561 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 13:23:35.683425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 13:23:35.685143 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 13:23:35.685143 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.685143 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8a64a0f6-f240-450f-8e67-a3589ec94880 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:35.685143 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8a64a0f6-f240-450f-8e67-a3589ec94880 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.127142 Jun 03 13:23:35.685143 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 489/985] 10.222.0.58 () {60 vars in 1155 bytes} [Fri Jun 3 13:23:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:23:35.690661 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ac571d2a-f1b5-413b-9775-50817f7134d0 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Action: 'create', calling method: .version_select at 0x7fc5a4352f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-660226151", "metadata": {"Type": "work"}}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ac571d2a-f1b5-413b-9775-50817f7134d0 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Request method failure captured: Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 119 Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgtXZCkHnb8_mJ-pbl2tIpGLom1whEEYR3x3upOyC9jEcC25epc__bz8gTUitCdx_hVxplElHYsF8Zp9Oxl3_A1H3FkDHxmwYdkcu1dA-faLfpc0m8GbkhKpFTOXiQIQBjPNAl1v3KP4f6f_jRbWEQK6HnpSuXjqE52dLXMdx47vTDc Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: a03d9ba6ec06469988d61a01396e520b Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:23:35.693868 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a03d9ba6ec06469988d61a01396e520b"}]}] Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: a03d9ba6ec06469988d61a01396e520b Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesNegativeTest-282441565-project Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: a09f0d946a0b4bc482a823a64acb7051 Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesNegativeTest-282441565-project Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-660226151", "metadata": {"Type": "work"}}} Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: Jun 03 13:23:35.695762 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-660226151', 'metadata': {'Type': 'work'}}}} Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise error Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi '0' Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:35.696791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 13:23:35.698513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 13:23:35.700354 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 13:23:35.700354 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.700354 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ac571d2a-f1b5-413b-9775-50817f7134d0 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:35.700354 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ac571d2a-f1b5-413b-9775-50817f7134d0 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008545 Jun 03 13:23:35.700354 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 497/986] 10.222.0.58 () {60 vars in 1155 bytes} [Fri Jun 3 13:23:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 13:23:35.704955 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-65b37583-8bd2-4eae-820d-66582c9b510a tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Action: 'create', calling method: .version_select at 0x7fc5a40f7a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1800231867", "metadata": {"Type": "work"}}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-65b37583-8bd2-4eae-820d-66582c9b510a tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Request method failure captured: Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 119 Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgtXZCkHnb8_mJ-pbl2tIpGLom1whEEYR3x3upOyC9jEcC25epc__bz8gTUitCdx_hVxplElHYsF8Zp9Oxl3_A1H3FkDHxmwYdkcu1dA-faLfpc0m8GbkhKpFTOXiQIQBjPNAl1v3KP4f6f_jRbWEQK6HnpSuXjqE52dLXMdx47vTDc Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: a03d9ba6ec06469988d61a01396e520b Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:23:35.707321 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a03d9ba6ec06469988d61a01396e520b"}]}] Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: a03d9ba6ec06469988d61a01396e520b Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesNegativeTest-282441565-project Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: a09f0d946a0b4bc482a823a64acb7051 Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesNegativeTest-282441565-project Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1800231867", "metadata": {"Type": "work"}}} Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: Jun 03 13:23:35.708960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1800231867', 'metadata': {'Type': 'work'}}}} Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise error Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi '' Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:35.710154 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 13:23:35.711838 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 13:23:35.713245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 13:23:35.713245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.713245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-65b37583-8bd2-4eae-820d-66582c9b510a tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:35.713245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-65b37583-8bd2-4eae-820d-66582c9b510a tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007414 Jun 03 13:23:35.713245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 490/987] 10.222.0.58 () {60 vars in 1155 bytes} [Fri Jun 3 13:23:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 03 13:23:35.774355 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-92b2e6b3-f863-4bcd-97be-127f635aa2df tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Calling method '.version_select at 0x7fc5a957bd30>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:35.815152 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-92b2e6b3-f863-4bcd-97be-127f635aa2df tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] HTTP exception thrown: Volume tempest-invalid-750359194 could not be found. Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-92b2e6b3-f863-4bcd-97be-127f635aa2df tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Request method failure captured: Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-750359194 HTTP/1.1 Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgtXZCkHnb8_mJ-pbl2tIpGLom1whEEYR3x3upOyC9jEcC25epc__bz8gTUitCdx_hVxplElHYsF8Zp9Oxl3_A1H3FkDHxmwYdkcu1dA-faLfpc0m8GbkhKpFTOXiQIQBjPNAl1v3KP4f6f_jRbWEQK6HnpSuXjqE52dLXMdx47vTDc Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: a03d9ba6ec06469988d61a01396e520b Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:23:35.818265 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a03d9ba6ec06469988d61a01396e520b"}]}] Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: a03d9ba6ec06469988d61a01396e520b Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesNegativeTest-282441565-project Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: a09f0d946a0b4bc482a823a64acb7051 Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesNegativeTest-282441565-project Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Volume tempest-invalid-750359194 could not be found. Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': 'tempest-invalid-750359194'} Jun 03 13:23:35.819823 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-750359194 could not be found. (HTTP 404) (Request-ID: req-6e5aba60-db51-4244-94eb-aa33a06b1f2a) Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.820712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 13:23:35.822018 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-750359194 could not be found. Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:35.823262 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-750359194 could not be found. Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-750359194 could not be found. Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-92b2e6b3-f863-4bcd-97be-127f635aa2df tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Returning 404 to user: Volume tempest-invalid-750359194 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-92b2e6b3-f863-4bcd-97be-127f635aa2df tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-750359194" status: 404 len: 98 microversion: 2.1 time: 0.050003 Jun 03 13:23:35.824843 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 498/988] 10.222.0.58 () {58 vars in 1214 bytes} [Fri Jun 3 13:23:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-750359194 => generated 98 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 03 13:23:35.831650 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-33ef0c9a-a779-4ad5-b3b6-75cd711bc753 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003844 Jun 03 13:23:35.832143 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 491/989] 10.222.0.58 () {58 vars in 1139 bytes} [Fri Jun 3 13:23:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 13:23:35.843209 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-5e86fd4e-6932-4554-a013-a553af3f6187 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004280 Jun 03 13:23:35.843714 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 499/990] 10.222.0.58 () {58 vars in 1136 bytes} [Fri Jun 3 13:23:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 13:23:35.853112 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cba20489-f74d-44f7-bb46-ae62adee52f8 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Calling method '.version_select at 0x7fc5a4cbc3a0>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:35.883020 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-cba20489-f74d-44f7-bb46-ae62adee52f8 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] HTTP exception thrown: Volume dba5128a-f11e-4987-97bf-4d70cd21163c could not be found. Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cba20489-f74d-44f7-bb46-ae62adee52f8 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Request method failure captured: Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: DELETE /compute/v2.1/os-volumes/dba5128a-f11e-4987-97bf-4d70cd21163c HTTP/1.1 Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgtXZCkHnb8_mJ-pbl2tIpGLom1whEEYR3x3upOyC9jEcC25epc__bz8gTUitCdx_hVxplElHYsF8Zp9Oxl3_A1H3FkDHxmwYdkcu1dA-faLfpc0m8GbkhKpFTOXiQIQBjPNAl1v3KP4f6f_jRbWEQK6HnpSuXjqE52dLXMdx47vTDc Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: a03d9ba6ec06469988d61a01396e520b Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:23:35.884968 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a03d9ba6ec06469988d61a01396e520b"}]}] Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: a03d9ba6ec06469988d61a01396e520b Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesNegativeTest-282441565-project Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: a09f0d946a0b4bc482a823a64acb7051 Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesNegativeTest-282441565-project Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Volume dba5128a-f11e-4987-97bf-4d70cd21163c could not be found. Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': 'dba5128a-f11e-4987-97bf-4d70cd21163c'} Jun 03 13:23:35.886743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dba5128a-f11e-4987-97bf-4d70cd21163c could not be found. (HTTP 404) (Request-ID: req-387fac25-7e24-42ae-ac12-663a6aa6eff8) Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.888045 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 13:23:35.889533 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dba5128a-f11e-4987-97bf-4d70cd21163c could not be found. Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 13:23:35.890862 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dba5128a-f11e-4987-97bf-4d70cd21163c could not be found. Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dba5128a-f11e-4987-97bf-4d70cd21163c could not be found. Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-cba20489-f74d-44f7-bb46-ae62adee52f8 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Returning 404 to user: Volume dba5128a-f11e-4987-97bf-4d70cd21163c could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-cba20489-f74d-44f7-bb46-ae62adee52f8 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/dba5128a-f11e-4987-97bf-4d70cd21163c" status: 404 len: 109 microversion: 2.1 time: 0.037034 Jun 03 13:23:35.892453 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 492/991] 10.222.0.58 () {58 vars in 1247 bytes} [Fri Jun 3 13:23:35 2022] DELETE /compute/v2.1/os-volumes/dba5128a-f11e-4987-97bf-4d70cd21163c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:23:35.896348 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-33f91e9a-939a-4ad4-b6d0-58555b2dea65 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Calling method '.version_select at 0x7fc5a4360d30>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:35.923959 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-33f91e9a-939a-4ad4-b6d0-58555b2dea65 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] HTTP exception thrown: Volume 031c7359-f2c0-4fca-b940-6dc6c263782d could not be found. Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-33f91e9a-939a-4ad4-b6d0-58555b2dea65 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Request method failure captured: Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/os-volumes/031c7359-f2c0-4fca-b940-6dc6c263782d HTTP/1.1 Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgtXZCkHnb8_mJ-pbl2tIpGLom1whEEYR3x3upOyC9jEcC25epc__bz8gTUitCdx_hVxplElHYsF8Zp9Oxl3_A1H3FkDHxmwYdkcu1dA-faLfpc0m8GbkhKpFTOXiQIQBjPNAl1v3KP4f6f_jRbWEQK6HnpSuXjqE52dLXMdx47vTDc Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: a03d9ba6ec06469988d61a01396e520b Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:23:35.925895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a03d9ba6ec06469988d61a01396e520b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a03d9ba6ec06469988d61a01396e520b"}]}] Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: a03d9ba6ec06469988d61a01396e520b Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesNegativeTest-282441565 Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesNegativeTest-282441565-project Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: a09f0d946a0b4bc482a823a64acb7051 Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesNegativeTest-282441565-project Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Volume 031c7359-f2c0-4fca-b940-6dc6c263782d could not be found. Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '031c7359-f2c0-4fca-b940-6dc6c263782d'} Jun 03 13:23:35.927335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 031c7359-f2c0-4fca-b940-6dc6c263782d could not be found. (HTTP 404) (Request-ID: req-6a2df5f4-4fab-4f71-aca8-767805fe1125) Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.928162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 13:23:35.929598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 031c7359-f2c0-4fca-b940-6dc6c263782d could not be found. Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 13:23:35.930920 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 031c7359-f2c0-4fca-b940-6dc6c263782d could not be found. Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 031c7359-f2c0-4fca-b940-6dc6c263782d could not be found. Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-33f91e9a-939a-4ad4-b6d0-58555b2dea65 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] Returning 404 to user: Volume 031c7359-f2c0-4fca-b940-6dc6c263782d could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-33f91e9a-939a-4ad4-b6d0-58555b2dea65 tempest-VolumesNegativeTest-282441565 tempest-VolumesNegativeTest-282441565-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/031c7359-f2c0-4fca-b940-6dc6c263782d" status: 404 len: 109 microversion: 2.1 time: 0.034866 Jun 03 13:23:35.932193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 500/992] 10.222.0.58 () {58 vars in 1244 bytes} [Fri Jun 3 13:23:35 2022] GET /compute/v2.1/os-volumes/031c7359-f2c0-4fca-b940-6dc6c263782d => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:23:53.188228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=22 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:53.189189 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:53.194733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1099114226", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "networks": [{"uuid": "fe2be48d-f217-4c5f-a0b6-606f7ae61421"}]}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:23:53.251226 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] validate_networks() for [('fe2be48d-f217-4c5f-a0b6-606f7ae61421', None, None, None, None, None)] {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:23:53.611953 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:23:53.612402 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:23:53.612863 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:23:53.613299 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:23:53.613726 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:23:53.624026 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:53.624470 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:53.625267 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:53.625698 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:53.643592 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Getting quotas for project d5f901d8296a4075a06edb88254fd64c. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:23:53.647933 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Getting quotas for user bbc528bdcebc434896efcf8bfd9f4f02 and project d5f901d8296a4075a06edb88254fd64c. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:23:53.659489 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:23:53.661998 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:23:53.707549 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-db990e90-3fdb-46d3-a3ed-4f93866aef5a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521733 Jun 03 13:23:53.708200 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 493/993] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:23:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:23:53.716356 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:53.717178 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:23:53.722490 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-335c450f-9ced-492a-b4a4-546602cb51ad tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:53.723130 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-335c450f-9ced-492a-b4a4-546602cb51ad tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:53.780844 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-335c450f-9ced-492a-b4a4-546602cb51ad tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:53.787574 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-335c450f-9ced-492a-b4a4-546602cb51ad tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1214 microversion: 2.1 time: 0.072605 Jun 03 13:23:53.788139 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 501/994] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:53 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:54.805480 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-520e82e5-0873-4488-ab67-bdf7e45b4ddc tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:54.806683 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-520e82e5-0873-4488-ab67-bdf7e45b4ddc tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:54.860974 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-520e82e5-0873-4488-ab67-bdf7e45b4ddc tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:54.870491 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-520e82e5-0873-4488-ab67-bdf7e45b4ddc tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1214 microversion: 2.1 time: 0.069387 Jun 03 13:23:54.871057 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 494/995] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:54 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:55.889925 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3542b0d6-7925-4b13-9272-1c518177d5a7 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:55.890800 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3542b0d6-7925-4b13-9272-1c518177d5a7 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:55.949335 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3542b0d6-7925-4b13-9272-1c518177d5a7 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:55.956131 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3542b0d6-7925-4b13-9272-1c518177d5a7 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1214 microversion: 2.1 time: 0.072442 Jun 03 13:23:55.956723 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 502/996] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:55 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:56.977176 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-19309a71-38ad-483b-a28e-b9a66350a782 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:56.978515 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-19309a71-38ad-483b-a28e-b9a66350a782 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:57.039106 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-19309a71-38ad-483b-a28e-b9a66350a782 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:57.046834 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-19309a71-38ad-483b-a28e-b9a66350a782 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1214 microversion: 2.1 time: 0.076135 Jun 03 13:23:57.047526 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 495/997] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:56 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:58.064346 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fc9f19f3-fe30-44b9-8b0f-ce3ea85b680d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:58.064980 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fc9f19f3-fe30-44b9-8b0f-ce3ea85b680d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:58.075950 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc9f19f3-fe30-44b9-8b0f-ce3ea85b680d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:58.076489 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc9f19f3-fe30-44b9-8b0f-ce3ea85b680d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:58.077352 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc9f19f3-fe30-44b9-8b0f-ce3ea85b680d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:58.077930 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fc9f19f3-fe30-44b9-8b0f-ce3ea85b680d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:58.142842 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fc9f19f3-fe30-44b9-8b0f-ce3ea85b680d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:58.150865 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fc9f19f3-fe30-44b9-8b0f-ce3ea85b680d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1218 microversion: 2.1 time: 0.090141 Jun 03 13:23:58.151264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 503/998] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:58 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:59.166926 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-e9d5b09c-8c21-4560-b618-a26c3859b83e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:23:59.167667 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-e9d5b09c-8c21-4560-b618-a26c3859b83e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:23:59.175229 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9d5b09c-8c21-4560-b618-a26c3859b83e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:59.175679 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9d5b09c-8c21-4560-b618-a26c3859b83e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:59.176461 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9d5b09c-8c21-4560-b618-a26c3859b83e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:23:59.176899 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-e9d5b09c-8c21-4560-b618-a26c3859b83e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:23:59.239402 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-e9d5b09c-8c21-4560-b618-a26c3859b83e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:23:59.247811 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-e9d5b09c-8c21-4560-b618-a26c3859b83e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1272 microversion: 2.1 time: 0.084893 Jun 03 13:23:59.248389 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 496/999] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:23:59 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:23:59.971860 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:23:59.972396 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Fri Jun 3 13:23:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:24:00.102908 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-a062a3ac-497c-4c45-a4d7-caa1037c31c0 req-2f8d52c9-570e-4fe0-8cd4-f7a448ad7d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "622c4b23-f23d-40a1-b37d-e3a6fadc85ec", "tag": "9352e053-ca97-4e5f-a321-bd508b9634c8"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:00.112956 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a062a3ac-497c-4c45-a4d7-caa1037c31c0 req-2f8d52c9-570e-4fe0-8cd4-f7a448ad7d6c service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:00.113423 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-a062a3ac-497c-4c45-a4d7-caa1037c31c0 req-2f8d52c9-570e-4fe0-8cd4-f7a448ad7d6c service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:00.133004 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-a062a3ac-497c-4c45-a4d7-caa1037c31c0 req-2f8d52c9-570e-4fe0-8cd4-f7a448ad7d6c service nova] Creating event network-changed:9352e053-ca97-4e5f-a321-bd508b9634c8 for instance 622c4b23-f23d-40a1-b37d-e3a6fadc85ec on hv-cinder-77954 Jun 03 13:24:00.138006 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-a062a3ac-497c-4c45-a4d7-caa1037c31c0 req-2f8d52c9-570e-4fe0-8cd4-f7a448ad7d6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038848 Jun 03 13:24:00.138663 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 504/1000] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:24:00.264980 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0ef2aca4-8685-4676-9b5b-0ee8feae0e85 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:00.265704 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0ef2aca4-8685-4676-9b5b-0ee8feae0e85 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:00.272839 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0ef2aca4-8685-4676-9b5b-0ee8feae0e85 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:00.273299 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0ef2aca4-8685-4676-9b5b-0ee8feae0e85 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:00.274159 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0ef2aca4-8685-4676-9b5b-0ee8feae0e85 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:00.274801 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0ef2aca4-8685-4676-9b5b-0ee8feae0e85 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:00.409608 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0ef2aca4-8685-4676-9b5b-0ee8feae0e85 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:00.417426 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0ef2aca4-8685-4676-9b5b-0ee8feae0e85 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1314 microversion: 2.1 time: 0.156379 Jun 03 13:24:00.418016 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 497/1001] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:00 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:01.441020 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ab60cd7e-0235-4c2d-b3bc-b3985194951a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:01.441998 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ab60cd7e-0235-4c2d-b3bc-b3985194951a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:01.451142 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab60cd7e-0235-4c2d-b3bc-b3985194951a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:01.451576 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab60cd7e-0235-4c2d-b3bc-b3985194951a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:01.452368 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab60cd7e-0235-4c2d-b3bc-b3985194951a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:01.452805 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ab60cd7e-0235-4c2d-b3bc-b3985194951a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:01.584749 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ab60cd7e-0235-4c2d-b3bc-b3985194951a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:01.593442 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ab60cd7e-0235-4c2d-b3bc-b3985194951a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1314 microversion: 2.1 time: 0.160423 Jun 03 13:24:01.594015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 505/1002] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:01 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:02.615795 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-423b7831-f2ed-4827-b048-28d38649486b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:02.616752 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-423b7831-f2ed-4827-b048-28d38649486b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:02.623708 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-423b7831-f2ed-4827-b048-28d38649486b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:02.624153 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-423b7831-f2ed-4827-b048-28d38649486b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:02.624920 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-423b7831-f2ed-4827-b048-28d38649486b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:02.625347 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-423b7831-f2ed-4827-b048-28d38649486b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:02.759109 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-423b7831-f2ed-4827-b048-28d38649486b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:02.768030 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-423b7831-f2ed-4827-b048-28d38649486b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1314 microversion: 2.1 time: 0.156162 Jun 03 13:24:02.768635 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 498/1003] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:02 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:03.785827 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c07e22bd-0ded-4ff9-947b-ccb2f0bb346a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:03.786866 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c07e22bd-0ded-4ff9-947b-ccb2f0bb346a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:03.796095 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c07e22bd-0ded-4ff9-947b-ccb2f0bb346a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:03.796480 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c07e22bd-0ded-4ff9-947b-ccb2f0bb346a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:03.797260 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c07e22bd-0ded-4ff9-947b-ccb2f0bb346a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:03.797693 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c07e22bd-0ded-4ff9-947b-ccb2f0bb346a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:03.936520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c07e22bd-0ded-4ff9-947b-ccb2f0bb346a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:03.944074 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c07e22bd-0ded-4ff9-947b-ccb2f0bb346a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1314 microversion: 2.1 time: 0.162853 Jun 03 13:24:03.944684 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 506/1004] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:03 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:04.965416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-79fb59ec-b14d-43ec-9099-9f855ff4e499 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:04.966442 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-79fb59ec-b14d-43ec-9099-9f855ff4e499 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:04.970309 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:04.979530 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79fb59ec-b14d-43ec-9099-9f855ff4e499 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:04.980200 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79fb59ec-b14d-43ec-9099-9f855ff4e499 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:04.980983 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79fb59ec-b14d-43ec-9099-9f855ff4e499 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:04.981414 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-79fb59ec-b14d-43ec-9099-9f855ff4e499 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:05.128433 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-79fb59ec-b14d-43ec-9099-9f855ff4e499 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:05.136136 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-79fb59ec-b14d-43ec-9099-9f855ff4e499 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1314 microversion: 2.1 time: 0.178036 Jun 03 13:24:05.136696 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 499/1005] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:04 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:05.875468 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-8fa20521-dbba-4be6-a543-e5f100f546cf req-e0e2fdf2-a8d3-4978-9b99-a3471e61bd69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622c4b23-f23d-40a1-b37d-e3a6fadc85ec", "name": "network-vif-plugged", "status": "completed", "tag": "9352e053-ca97-4e5f-a321-bd508b9634c8"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:05.885199 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8fa20521-dbba-4be6-a543-e5f100f546cf req-e0e2fdf2-a8d3-4978-9b99-a3471e61bd69 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:05.885747 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-8fa20521-dbba-4be6-a543-e5f100f546cf req-e0e2fdf2-a8d3-4978-9b99-a3471e61bd69 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:05.897361 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-8fa20521-dbba-4be6-a543-e5f100f546cf req-e0e2fdf2-a8d3-4978-9b99-a3471e61bd69 service nova] Creating event network-vif-plugged:9352e053-ca97-4e5f-a321-bd508b9634c8 for instance 622c4b23-f23d-40a1-b37d-e3a6fadc85ec on hv-cinder-77954 Jun 03 13:24:05.902518 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-8fa20521-dbba-4be6-a543-e5f100f546cf req-e0e2fdf2-a8d3-4978-9b99-a3471e61bd69 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030713 Jun 03 13:24:05.903299 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 507/1006] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 13:24:06.153864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-56c2cebc-6fc6-44f8-b412-7ae88515afc8 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:06.154492 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-56c2cebc-6fc6-44f8-b412-7ae88515afc8 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:06.162217 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56c2cebc-6fc6-44f8-b412-7ae88515afc8 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:06.162673 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56c2cebc-6fc6-44f8-b412-7ae88515afc8 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:06.163471 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56c2cebc-6fc6-44f8-b412-7ae88515afc8 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:06.163886 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-56c2cebc-6fc6-44f8-b412-7ae88515afc8 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:06.309924 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-56c2cebc-6fc6-44f8-b412-7ae88515afc8 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:06.317983 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-56c2cebc-6fc6-44f8-b412-7ae88515afc8 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1314 microversion: 2.1 time: 0.168896 Jun 03 13:24:06.318600 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 500/1007] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:06 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:07.335783 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=4 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:07.342331 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-91f3bf92-58ff-4dca-9370-76b9c333c8c3 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:07.343046 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-91f3bf92-58ff-4dca-9370-76b9c333c8c3 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:07.349828 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91f3bf92-58ff-4dca-9370-76b9c333c8c3 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:07.350333 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91f3bf92-58ff-4dca-9370-76b9c333c8c3 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:07.351122 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91f3bf92-58ff-4dca-9370-76b9c333c8c3 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:07.351562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-91f3bf92-58ff-4dca-9370-76b9c333c8c3 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:07.495790 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-91f3bf92-58ff-4dca-9370-76b9c333c8c3 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:07.504661 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-91f3bf92-58ff-4dca-9370-76b9c333c8c3 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1314 microversion: 2.1 time: 0.170396 Jun 03 13:24:07.505232 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 508/1008] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:07 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:08.522602 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-d11f44e1-99e1-4957-aec3-ce5d5151d6c1 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:08.523233 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-d11f44e1-99e1-4957-aec3-ce5d5151d6c1 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:08.525073 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=10 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:08.531656 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d11f44e1-99e1-4957-aec3-ce5d5151d6c1 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:08.532110 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d11f44e1-99e1-4957-aec3-ce5d5151d6c1 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:08.532898 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d11f44e1-99e1-4957-aec3-ce5d5151d6c1 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:08.533334 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-d11f44e1-99e1-4957-aec3-ce5d5151d6c1 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:08.675129 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-d11f44e1-99e1-4957-aec3-ce5d5151d6c1 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:08.686617 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-d11f44e1-99e1-4957-aec3-ce5d5151d6c1 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1498 microversion: 2.1 time: 0.167967 Jun 03 13:24:08.687191 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 501/1009] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:08 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:09.085870 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e4333f4e-9b50-4180-a01b-54653cf68671 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:09.086430 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e4333f4e-9b50-4180-a01b-54653cf68671 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:09.092931 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4333f4e-9b50-4180-a01b-54653cf68671 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:09.093371 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4333f4e-9b50-4180-a01b-54653cf68671 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:09.094156 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4333f4e-9b50-4180-a01b-54653cf68671 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:09.094754 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e4333f4e-9b50-4180-a01b-54653cf68671 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:09.119949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e4333f4e-9b50-4180-a01b-54653cf68671 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:24:09.204079 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e4333f4e-9b50-4180-a01b-54653cf68671 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "DELETE /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 204 len: 0 microversion: 2.1 time: 0.121722 Jun 03 13:24:09.204720 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 509/1010] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:24:09 2022] DELETE /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:24:09.213085 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-23745853-5c7e-4768-8e8b-4a9028046f67 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:09.213800 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-23745853-5c7e-4768-8e8b-4a9028046f67 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:09.220369 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23745853-5c7e-4768-8e8b-4a9028046f67 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:09.220823 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23745853-5c7e-4768-8e8b-4a9028046f67 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:09.221689 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23745853-5c7e-4768-8e8b-4a9028046f67 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:09.222149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23745853-5c7e-4768-8e8b-4a9028046f67 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:09.363162 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-23745853-5c7e-4768-8e8b-4a9028046f67 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:09.374721 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-23745853-5c7e-4768-8e8b-4a9028046f67 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1504 microversion: 2.1 time: 0.165552 Jun 03 13:24:09.375230 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 502/1011] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:09 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:10.392103 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0d81bdfb-8e86-4e35-9cf8-06c329537924 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:10.392852 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0d81bdfb-8e86-4e35-9cf8-06c329537924 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:10.399824 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d81bdfb-8e86-4e35-9cf8-06c329537924 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:10.400276 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d81bdfb-8e86-4e35-9cf8-06c329537924 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:10.401052 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d81bdfb-8e86-4e35-9cf8-06c329537924 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:10.401487 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0d81bdfb-8e86-4e35-9cf8-06c329537924 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:10.536468 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0d81bdfb-8e86-4e35-9cf8-06c329537924 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:10.544327 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0d81bdfb-8e86-4e35-9cf8-06c329537924 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1504 microversion: 2.1 time: 0.156519 Jun 03 13:24:10.545165 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 510/1012] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:10 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:11.228491 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-20f8d062-50cd-4036-a6cf-109c6cef103f req-510f390a-00f9-4a5f-a23d-e65fdaf95ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "622c4b23-f23d-40a1-b37d-e3a6fadc85ec", "name": "network-vif-deleted", "tag": "9352e053-ca97-4e5f-a321-bd508b9634c8"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:11.240604 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-20f8d062-50cd-4036-a6cf-109c6cef103f req-510f390a-00f9-4a5f-a23d-e65fdaf95ac6 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:11.241216 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-20f8d062-50cd-4036-a6cf-109c6cef103f req-510f390a-00f9-4a5f-a23d-e65fdaf95ac6 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:11.254570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-20f8d062-50cd-4036-a6cf-109c6cef103f req-510f390a-00f9-4a5f-a23d-e65fdaf95ac6 service nova] Creating event network-vif-deleted:9352e053-ca97-4e5f-a321-bd508b9634c8 for instance 622c4b23-f23d-40a1-b37d-e3a6fadc85ec on hv-cinder-77954 Jun 03 13:24:11.260374 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-20f8d062-50cd-4036-a6cf-109c6cef103f req-510f390a-00f9-4a5f-a23d-e65fdaf95ac6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035692 Jun 03 13:24:11.261207 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 503/1013] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:24:11.561787 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ffff2862-af44-4d9b-ae08-c23c7227917d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:11.562558 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ffff2862-af44-4d9b-ae08-c23c7227917d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:11.569445 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffff2862-af44-4d9b-ae08-c23c7227917d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:11.569903 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffff2862-af44-4d9b-ae08-c23c7227917d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:11.570714 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffff2862-af44-4d9b-ae08-c23c7227917d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:11.571153 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffff2862-af44-4d9b-ae08-c23c7227917d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:11.603710 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffff2862-af44-4d9b-ae08-c23c7227917d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:11.604169 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ffff2862-af44-4d9b-ae08-c23c7227917d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:11.604630 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-ffff2862-af44-4d9b-ae08-c23c7227917d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lazy-loading 'fault' on Instance uuid 622c4b23-f23d-40a1-b37d-e3a6fadc85ec {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:24:11.649200 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ffff2862-af44-4d9b-ae08-c23c7227917d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:11.657061 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ffff2862-af44-4d9b-ae08-c23c7227917d tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 200 len: 1304 microversion: 2.1 time: 0.099300 Jun 03 13:24:11.657632 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 511/1014] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:11 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:12.680923 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-50fb8290-72bb-4bda-bc0f-09537a34af44 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:12.682163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-50fb8290-72bb-4bda-bc0f-09537a34af44 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 622c4b23-f23d-40a1-b37d-e3a6fadc85ec] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:12.690727 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50fb8290-72bb-4bda-bc0f-09537a34af44 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:12.691176 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50fb8290-72bb-4bda-bc0f-09537a34af44 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:12.691942 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50fb8290-72bb-4bda-bc0f-09537a34af44 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:12.692376 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-50fb8290-72bb-4bda-bc0f-09537a34af44 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:12.705645 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-50fb8290-72bb-4bda-bc0f-09537a34af44 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] HTTP exception thrown: Instance 622c4b23-f23d-40a1-b37d-e3a6fadc85ec could not be found. Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-50fb8290-72bb-4bda-bc0f-09537a34af44 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Request method failure captured: Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec HTTP/1.1 Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgtnkGUP27REsL3thF61KPkwuOy_u9Ln_V0m_cu2hpjwV79s4B8nCzz_46qqF3-7w4-8vqaRJ1thmvUZAqHaiC_zvKjVpQqDzKeTYI8eGgZRAQLddF7nLL9jf5OL7QC_7qi-u-zk7KqngG9RAiKA7kBSLeY61lwbJR5gdU_L_iX_uUE Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: d5f901d8296a4075a06edb88254fd64c Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-VolumesActionsTest-1390627063 Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:24:12.707271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:24:12.708882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5f901d8296a4075a06edb88254fd64c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5f901d8296a4075a06edb88254fd64c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5f901d8296a4075a06edb88254fd64c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5f901d8296a4075a06edb88254fd64c"}]}] Jun 03 13:24:12.708882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-VolumesActionsTest-1390627063 Jun 03 13:24:12.708882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: d5f901d8296a4075a06edb88254fd64c Jun 03 13:24:12.708882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-VolumesActionsTest-1390627063 Jun 03 13:24:12.708882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-VolumesActionsTest-1390627063-project Jun 03 13:24:12.708882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:24:12.708882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:24:12.708882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: bbc528bdcebc434896efcf8bfd9f4f02 Jun 03 13:24:12.708882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-VolumesActionsTest-1390627063-project Jun 03 13:24:12.708882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:24:12.708882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 622c4b23-f23d-40a1-b37d-e3a6fadc85ec could not be found. Jun 03 13:24:12.708882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '622c4b23-f23d-40a1-b37d-e3a6fadc85ec'} Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 622c4b23-f23d-40a1-b37d-e3a6fadc85ec could not be found. Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:24:12.709764 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 622c4b23-f23d-40a1-b37d-e3a6fadc85ec could not be found. Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 622c4b23-f23d-40a1-b37d-e3a6fadc85ec could not be found. Jun 03 13:24:12.711425 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:24:12.712879 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-50fb8290-72bb-4bda-bc0f-09537a34af44 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Returning 404 to user: Instance 622c4b23-f23d-40a1-b37d-e3a6fadc85ec could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:24:12.712879 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-50fb8290-72bb-4bda-bc0f-09537a34af44 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec" status: 404 len: 111 microversion: 2.1 time: 0.034948 Jun 03 13:24:12.712879 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 504/1015] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:12 2022] GET /compute/v2.1/servers/622c4b23-f23d-40a1-b37d-e3a6fadc85ec => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:24:12.758848 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1782889224", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452", "networks": [{"uuid": "fe2be48d-f217-4c5f-a0b6-606f7ae61421"}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:12.812187 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] validate_networks() for [('fe2be48d-f217-4c5f-a0b6-606f7ae61421', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:24:13.234148 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:24:13.234604 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:24:13.235088 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:24:13.235509 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:24:13.235925 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:24:13.245993 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:13.246478 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:13.247291 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:13.248027 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:13.265540 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Getting quotas for project d5f901d8296a4075a06edb88254fd64c. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:24:13.269984 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Getting quotas for user bbc528bdcebc434896efcf8bfd9f4f02 and project d5f901d8296a4075a06edb88254fd64c. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:24:13.282580 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:24:13.285047 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:24:13.337557 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bcef313d-3e6f-4dc3-8a95-d778d2e2b213 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582603 Jun 03 13:24:13.338230 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 512/1016] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:24:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:24:13.348804 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-389d54a3-fe97-4c9e-a4af-716bfc04ab70 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:13.349412 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-389d54a3-fe97-4c9e-a4af-716bfc04ab70 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:13.408484 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-389d54a3-fe97-4c9e-a4af-716bfc04ab70 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:13.415310 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-389d54a3-fe97-4c9e-a4af-716bfc04ab70 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 200 len: 1214 microversion: 2.1 time: 0.070436 Jun 03 13:24:13.416141 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 505/1017] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:13 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:14.432386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e9e1fbe1-f660-42ed-b5f8-f6bd2b4e7843 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:14.433106 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e9e1fbe1-f660-42ed-b5f8-f6bd2b4e7843 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:14.441325 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9e1fbe1-f660-42ed-b5f8-f6bd2b4e7843 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:14.441858 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9e1fbe1-f660-42ed-b5f8-f6bd2b4e7843 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:14.442676 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9e1fbe1-f660-42ed-b5f8-f6bd2b4e7843 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:14.443119 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9e1fbe1-f660-42ed-b5f8-f6bd2b4e7843 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:14.507305 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-e9e1fbe1-f660-42ed-b5f8-f6bd2b4e7843 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:14.515351 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e9e1fbe1-f660-42ed-b5f8-f6bd2b4e7843 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 200 len: 1272 microversion: 2.1 time: 0.086902 Jun 03 13:24:14.516126 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 513/1018] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:14 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:15.532171 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-70818646-10b8-403b-bc3b-8f1114797e0a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:15.532801 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-70818646-10b8-403b-bc3b-8f1114797e0a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:15.540402 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-70818646-10b8-403b-bc3b-8f1114797e0a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:15.540874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-70818646-10b8-403b-bc3b-8f1114797e0a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:15.541633 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-70818646-10b8-403b-bc3b-8f1114797e0a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:15.542310 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-70818646-10b8-403b-bc3b-8f1114797e0a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:15.624855 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-13f2fe80-8ead-4ad4-83ab-e1d9017363f1 req-832adf8d-6722-4a04-9ffe-6e695913a26b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9e8fc9-d69b-4425-b9e1-beb573ec9c67", "tag": "3dc0b595-6257-4ec5-9f69-ff1a47ab69bf"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:15.645188 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-13f2fe80-8ead-4ad4-83ab-e1d9017363f1 req-832adf8d-6722-4a04-9ffe-6e695913a26b service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:15.645637 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-13f2fe80-8ead-4ad4-83ab-e1d9017363f1 req-832adf8d-6722-4a04-9ffe-6e695913a26b service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:15.661683 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-13f2fe80-8ead-4ad4-83ab-e1d9017363f1 req-832adf8d-6722-4a04-9ffe-6e695913a26b service nova] Creating event network-changed:3dc0b595-6257-4ec5-9f69-ff1a47ab69bf for instance 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 on hv-cinder-77954 Jun 03 13:24:15.666677 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-13f2fe80-8ead-4ad4-83ab-e1d9017363f1 req-832adf8d-6722-4a04-9ffe-6e695913a26b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048674 Jun 03 13:24:15.667825 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 514/1019] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:24:15.681705 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-70818646-10b8-403b-bc3b-8f1114797e0a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:15.689644 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-70818646-10b8-403b-bc3b-8f1114797e0a tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 200 len: 1314 microversion: 2.1 time: 0.161590 Jun 03 13:24:15.690247 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 506/1020] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:15 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:16.708010 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-56da6c95-390a-4f69-b512-e8c71beaa05b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:16.708723 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-56da6c95-390a-4f69-b512-e8c71beaa05b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:16.715582 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56da6c95-390a-4f69-b512-e8c71beaa05b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:16.716041 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56da6c95-390a-4f69-b512-e8c71beaa05b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:16.716808 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56da6c95-390a-4f69-b512-e8c71beaa05b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:16.717264 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-56da6c95-390a-4f69-b512-e8c71beaa05b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:16.852026 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-56da6c95-390a-4f69-b512-e8c71beaa05b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:16.859727 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-56da6c95-390a-4f69-b512-e8c71beaa05b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 200 len: 1314 microversion: 2.1 time: 0.156842 Jun 03 13:24:16.860299 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 515/1021] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:16 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:17.877588 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-40bb7cef-4561-463a-85e8-22178f7ff497 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:17.879044 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-40bb7cef-4561-463a-85e8-22178f7ff497 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:17.886063 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-40bb7cef-4561-463a-85e8-22178f7ff497 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:17.886550 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-40bb7cef-4561-463a-85e8-22178f7ff497 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:17.887341 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-40bb7cef-4561-463a-85e8-22178f7ff497 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:17.887743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-40bb7cef-4561-463a-85e8-22178f7ff497 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:18.036816 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-40bb7cef-4561-463a-85e8-22178f7ff497 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:18.051277 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-40bb7cef-4561-463a-85e8-22178f7ff497 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 200 len: 1314 microversion: 2.1 time: 0.177983 Jun 03 13:24:18.052227 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 507/1022] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:17 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:19.073159 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1fabe99d-e31e-4ea9-a999-80b504dba477 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:19.074169 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-1fabe99d-e31e-4ea9-a999-80b504dba477 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:19.085675 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fabe99d-e31e-4ea9-a999-80b504dba477 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:19.086522 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fabe99d-e31e-4ea9-a999-80b504dba477 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:19.087816 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fabe99d-e31e-4ea9-a999-80b504dba477 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:19.088554 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-1fabe99d-e31e-4ea9-a999-80b504dba477 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:19.226143 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-1fabe99d-e31e-4ea9-a999-80b504dba477 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:19.234203 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1fabe99d-e31e-4ea9-a999-80b504dba477 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 200 len: 1314 microversion: 2.1 time: 0.168039 Jun 03 13:24:19.234780 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 516/1023] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:19 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:19.968924 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-866f4c56-de18-4f2f-929c-5712033614dd req-914376dc-c413-4c8e-a958-6fa64ed6eca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9e8fc9-d69b-4425-b9e1-beb573ec9c67", "name": "network-vif-plugged", "status": "completed", "tag": "3dc0b595-6257-4ec5-9f69-ff1a47ab69bf"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:19.977488 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-866f4c56-de18-4f2f-929c-5712033614dd req-914376dc-c413-4c8e-a958-6fa64ed6eca4 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:19.977996 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-866f4c56-de18-4f2f-929c-5712033614dd req-914376dc-c413-4c8e-a958-6fa64ed6eca4 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:19.993093 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-866f4c56-de18-4f2f-929c-5712033614dd req-914376dc-c413-4c8e-a958-6fa64ed6eca4 service nova] Creating event network-vif-plugged:3dc0b595-6257-4ec5-9f69-ff1a47ab69bf for instance 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 on hv-cinder-77954 Jun 03 13:24:19.998253 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-866f4c56-de18-4f2f-929c-5712033614dd req-914376dc-c413-4c8e-a958-6fa64ed6eca4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033085 Jun 03 13:24:19.998845 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 508/1024] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:24:20.251514 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-26e70868-ea8c-4e12-a8e0-f3ce818de2a6 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:20.252378 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-26e70868-ea8c-4e12-a8e0-f3ce818de2a6 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:20.259347 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26e70868-ea8c-4e12-a8e0-f3ce818de2a6 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:20.259783 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26e70868-ea8c-4e12-a8e0-f3ce818de2a6 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:20.260558 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26e70868-ea8c-4e12-a8e0-f3ce818de2a6 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:20.260982 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-26e70868-ea8c-4e12-a8e0-f3ce818de2a6 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:20.405477 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-26e70868-ea8c-4e12-a8e0-f3ce818de2a6 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:20.417275 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-26e70868-ea8c-4e12-a8e0-f3ce818de2a6 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 200 len: 1314 microversion: 2.1 time: 0.169425 Jun 03 13:24:20.418013 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 517/1025] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:20 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:21.438796 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-23ddb6c0-ab32-4d9e-b539-8ae701fd78ab tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:21.439388 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-23ddb6c0-ab32-4d9e-b539-8ae701fd78ab tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:21.447190 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23ddb6c0-ab32-4d9e-b539-8ae701fd78ab tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:21.447640 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23ddb6c0-ab32-4d9e-b539-8ae701fd78ab tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:21.448416 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23ddb6c0-ab32-4d9e-b539-8ae701fd78ab tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:21.448849 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-23ddb6c0-ab32-4d9e-b539-8ae701fd78ab tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:21.592830 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-23ddb6c0-ab32-4d9e-b539-8ae701fd78ab tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:21.600542 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-23ddb6c0-ab32-4d9e-b539-8ae701fd78ab tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 200 len: 1314 microversion: 2.1 time: 0.168432 Jun 03 13:24:21.601306 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 509/1026] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:21 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:22.617964 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c48eaf29-ac82-4833-ad05-9c9754357b3b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:22.618556 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c48eaf29-ac82-4833-ad05-9c9754357b3b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:22.625502 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c48eaf29-ac82-4833-ad05-9c9754357b3b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:22.625955 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c48eaf29-ac82-4833-ad05-9c9754357b3b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:22.626770 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c48eaf29-ac82-4833-ad05-9c9754357b3b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:22.627218 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c48eaf29-ac82-4833-ad05-9c9754357b3b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:22.765535 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c48eaf29-ac82-4833-ad05-9c9754357b3b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:22.777034 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c48eaf29-ac82-4833-ad05-9c9754357b3b tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 200 len: 1498 microversion: 2.1 time: 0.163231 Jun 03 13:24:22.777786 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 518/1027] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:22 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:23.210952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0de6388e-74c9-4d41-a1a3-e7663b16f97e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:23.211515 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0de6388e-74c9-4d41-a1a3-e7663b16f97e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:23.213836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:23.219320 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0de6388e-74c9-4d41-a1a3-e7663b16f97e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:23.219758 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0de6388e-74c9-4d41-a1a3-e7663b16f97e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:23.220524 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0de6388e-74c9-4d41-a1a3-e7663b16f97e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:23.220947 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0de6388e-74c9-4d41-a1a3-e7663b16f97e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:23.224908 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=69 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:23.248743 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0de6388e-74c9-4d41-a1a3-e7663b16f97e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Going to try to terminate instance {{(pid=117726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:24:23.329888 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0de6388e-74c9-4d41-a1a3-e7663b16f97e tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 204 len: 0 microversion: 2.1 time: 0.122720 Jun 03 13:24:23.330513 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 510/1028] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:24:23 2022] DELETE /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:24:23.339389 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-04439c25-a44d-4d1f-aa0f-3345c4c86142 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:23.340015 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-04439c25-a44d-4d1f-aa0f-3345c4c86142 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:23.342137 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:23.342930 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:23.348637 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04439c25-a44d-4d1f-aa0f-3345c4c86142 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:23.349093 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04439c25-a44d-4d1f-aa0f-3345c4c86142 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:23.349973 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04439c25-a44d-4d1f-aa0f-3345c4c86142 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:23.350445 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-04439c25-a44d-4d1f-aa0f-3345c4c86142 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:23.487893 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-04439c25-a44d-4d1f-aa0f-3345c4c86142 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:23.496910 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-04439c25-a44d-4d1f-aa0f-3345c4c86142 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 200 len: 1504 microversion: 2.1 time: 0.161440 Jun 03 13:24:23.497576 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 519/1029] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:23 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:24.518791 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-237debb7-a539-4d59-897b-24bff40d5fa9 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:24.519504 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-237debb7-a539-4d59-897b-24bff40d5fa9 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:24.522426 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:24.529942 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-237debb7-a539-4d59-897b-24bff40d5fa9 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:24.530429 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-237debb7-a539-4d59-897b-24bff40d5fa9 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:24.531214 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-237debb7-a539-4d59-897b-24bff40d5fa9 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:24.531652 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-237debb7-a539-4d59-897b-24bff40d5fa9 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:24.668366 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-237debb7-a539-4d59-897b-24bff40d5fa9 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:24.676149 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-237debb7-a539-4d59-897b-24bff40d5fa9 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 200 len: 1504 microversion: 2.1 time: 0.164066 Jun 03 13:24:24.676709 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 511/1030] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:24 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:25.391069 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-33b4535d-d949-43f4-9c4c-73b3e0e25b7d req-6d9ae868-767b-4ff5-80e2-84b4e36fbf26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9e8fc9-d69b-4425-b9e1-beb573ec9c67", "name": "network-vif-deleted", "tag": "3dc0b595-6257-4ec5-9f69-ff1a47ab69bf"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:25.394950 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:25.400764 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-33b4535d-d949-43f4-9c4c-73b3e0e25b7d req-6d9ae868-767b-4ff5-80e2-84b4e36fbf26 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:25.401214 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-33b4535d-d949-43f4-9c4c-73b3e0e25b7d req-6d9ae868-767b-4ff5-80e2-84b4e36fbf26 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:25.403876 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:25.415871 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-33b4535d-d949-43f4-9c4c-73b3e0e25b7d req-6d9ae868-767b-4ff5-80e2-84b4e36fbf26 service nova] Creating event network-vif-deleted:3dc0b595-6257-4ec5-9f69-ff1a47ab69bf for instance 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 on hv-cinder-77954 Jun 03 13:24:25.421321 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-33b4535d-d949-43f4-9c4c-73b3e0e25b7d req-6d9ae868-767b-4ff5-80e2-84b4e36fbf26 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033978 Jun 03 13:24:25.422386 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 520/1031] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:24:25.694469 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b8eb1c45-0fb3-46cb-8dd2-db2a9a9321be tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:25.695152 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b8eb1c45-0fb3-46cb-8dd2-db2a9a9321be tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:25.703116 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8eb1c45-0fb3-46cb-8dd2-db2a9a9321be tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:25.703631 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8eb1c45-0fb3-46cb-8dd2-db2a9a9321be tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:25.704513 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8eb1c45-0fb3-46cb-8dd2-db2a9a9321be tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:25.705017 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8eb1c45-0fb3-46cb-8dd2-db2a9a9321be tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:25.738759 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8eb1c45-0fb3-46cb-8dd2-db2a9a9321be tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:25.739380 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b8eb1c45-0fb3-46cb-8dd2-db2a9a9321be tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:25.740082 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.objects.instance [None req-b8eb1c45-0fb3-46cb-8dd2-db2a9a9321be tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lazy-loading 'fault' on Instance uuid 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 {{(pid=117726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:24:25.782576 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b8eb1c45-0fb3-46cb-8dd2-db2a9a9321be tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc528bdcebc434896efcf8bfd9f4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f901d8296a4075a06edb88254fd64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:25.790904 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b8eb1c45-0fb3-46cb-8dd2-db2a9a9321be tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 200 len: 1304 microversion: 2.1 time: 0.100958 Jun 03 13:24:25.791490 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 512/1032] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:25 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:26.814772 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-74248c3a-805d-44f0-b90e-94487aaee709 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:26.815780 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-74248c3a-805d-44f0-b90e-94487aaee709 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] [instance: 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:26.825358 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74248c3a-805d-44f0-b90e-94487aaee709 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:26.825810 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74248c3a-805d-44f0-b90e-94487aaee709 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:26.826614 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74248c3a-805d-44f0-b90e-94487aaee709 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:26.827044 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-74248c3a-805d-44f0-b90e-94487aaee709 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:26.841645 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-74248c3a-805d-44f0-b90e-94487aaee709 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] HTTP exception thrown: Instance 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 could not be found. Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-74248c3a-805d-44f0-b90e-94487aaee709 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Request method failure captured: Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 HTTP/1.1 Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimgtnkGUP27REsL3thF61KPkwuOy_u9Ln_V0m_cu2hpjwV79s4B8nCzz_46qqF3-7w4-8vqaRJ1thmvUZAqHaiC_zvKjVpQqDzKeTYI8eGgZRAQLddF7nLL9jf5OL7QC_7qi-u-zk7KqngG9RAiKA7kBSLeY61lwbJR5gdU_L_iX_uUE Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: d5f901d8296a4075a06edb88254fd64c Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesActionsTest-1390627063 Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:24:26.843300 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:24:26.844949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5f901d8296a4075a06edb88254fd64c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5f901d8296a4075a06edb88254fd64c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5f901d8296a4075a06edb88254fd64c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5f901d8296a4075a06edb88254fd64c"}]}] Jun 03 13:24:26.844949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesActionsTest-1390627063 Jun 03 13:24:26.844949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: d5f901d8296a4075a06edb88254fd64c Jun 03 13:24:26.844949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesActionsTest-1390627063 Jun 03 13:24:26.844949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesActionsTest-1390627063-project Jun 03 13:24:26.844949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:24:26.844949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:24:26.844949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: bbc528bdcebc434896efcf8bfd9f4f02 Jun 03 13:24:26.844949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesActionsTest-1390627063-project Jun 03 13:24:26.844949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:24:26.844949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 could not be found. Jun 03 13:24:26.844949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': '3d9e8fc9-d69b-4425-b9e1-beb573ec9c67'} Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 could not be found. Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:24:26.845895 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 could not be found. Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 could not be found. Jun 03 13:24:26.847636 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:24:26.849672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-74248c3a-805d-44f0-b90e-94487aaee709 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] Returning 404 to user: Instance 3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:24:26.849672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-74248c3a-805d-44f0-b90e-94487aaee709 tempest-VolumesActionsTest-1390627063 tempest-VolumesActionsTest-1390627063-project] 10.222.0.58 "GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67" status: 404 len: 111 microversion: 2.1 time: 0.038203 Jun 03 13:24:26.849672 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 521/1033] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:26 2022] GET /compute/v2.1/servers/3d9e8fc9-d69b-4425-b9e1-beb573ec9c67 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:24:52.153831 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1179320167", "imageRef": "262b2b79-95df-4403-8337-0b52287abab2", "flavorRef": "452"}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:52.159514 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:52.160186 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:52.207742 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.network.neutron [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] validate_networks() for None {{(pid=117726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:24:52.489303 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Flavor limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:24:52.489733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Image limits 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:24:52.490242 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Flavor pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:24:52.490668 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Image pref 0:0:0 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:24:52.491082 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.virt.hardware [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:24:52.500984 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:52.501433 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:52.502276 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:52.502716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:52.519995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Getting quotas for project e19046007a41440fb351a8b44c30c4f2. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:24:52.523969 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Getting quotas for user 6c829393baab4e1a827604a57944e204 and project e19046007a41440fb351a8b44c30c4f2. Resources: {'instances', 'cores', 'ram'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:24:52.534983 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Going to run 1 instances... {{(pid=117726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:24:52.537259 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='262b2b79-95df-4403-8337-0b52287abab2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:24:52.584749 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-66284861-9638-451b-9631-50263d884496 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.434913 Jun 03 13:24:52.585401 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 513/1034] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:24:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:24:52.595851 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6427687f-7ad0-4f8b-8c09-f375cd5c1e11 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:52.596445 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6427687f-7ad0-4f8b-8c09-f375cd5c1e11 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:52.598625 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:52.599224 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:24:52.654376 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6427687f-7ad0-4f8b-8c09-f375cd5c1e11 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c829393baab4e1a827604a57944e204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19046007a41440fb351a8b44c30c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:52.661945 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6427687f-7ad0-4f8b-8c09-f375cd5c1e11 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 200 len: 1215 microversion: 2.1 time: 0.070088 Jun 03 13:24:52.662545 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 522/1035] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:52 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:53.678438 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1002105f-ee8a-4c50-b287-baac74fff23e tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:53.679053 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1002105f-ee8a-4c50-b287-baac74fff23e tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:53.686664 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1002105f-ee8a-4c50-b287-baac74fff23e tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:53.687180 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1002105f-ee8a-4c50-b287-baac74fff23e tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:53.688099 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1002105f-ee8a-4c50-b287-baac74fff23e tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:53.688546 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1002105f-ee8a-4c50-b287-baac74fff23e tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:53.761690 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1002105f-ee8a-4c50-b287-baac74fff23e tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c829393baab4e1a827604a57944e204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19046007a41440fb351a8b44c30c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:53.769828 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1002105f-ee8a-4c50-b287-baac74fff23e tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 200 len: 1273 microversion: 2.1 time: 0.095345 Jun 03 13:24:53.770479 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 514/1036] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:53 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:54.788016 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d789d85d-3710-4464-a063-5620b2ea8eb2 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:54.788638 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d789d85d-3710-4464-a063-5620b2ea8eb2 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:54.797293 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d789d85d-3710-4464-a063-5620b2ea8eb2 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:54.797740 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d789d85d-3710-4464-a063-5620b2ea8eb2 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:54.798562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d789d85d-3710-4464-a063-5620b2ea8eb2 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:54.798991 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d789d85d-3710-4464-a063-5620b2ea8eb2 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:54.930540 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d789d85d-3710-4464-a063-5620b2ea8eb2 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c829393baab4e1a827604a57944e204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19046007a41440fb351a8b44c30c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:54.938235 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d789d85d-3710-4464-a063-5620b2ea8eb2 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 200 len: 1315 microversion: 2.1 time: 0.154411 Jun 03 13:24:54.938814 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 523/1037] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:54 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:55.236126 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-aa3e1433-63cf-455d-8659-3925e38af4fe req-0835a87a-a22c-4617-9053-73a6ca59d314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5da70b1-d9c0-4123-a86b-b452394c1804", "tag": "86ae5d43-ca46-4e1f-a9c4-c3777d030874"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:24:55.250223 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-aa3e1433-63cf-455d-8659-3925e38af4fe req-0835a87a-a22c-4617-9053-73a6ca59d314 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:55.250988 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-aa3e1433-63cf-455d-8659-3925e38af4fe req-0835a87a-a22c-4617-9053-73a6ca59d314 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:55.271690 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-aa3e1433-63cf-455d-8659-3925e38af4fe req-0835a87a-a22c-4617-9053-73a6ca59d314 service nova] Creating event network-changed:86ae5d43-ca46-4e1f-a9c4-c3777d030874 for instance e5da70b1-d9c0-4123-a86b-b452394c1804 on hv-cinder-77954 Jun 03 13:24:55.277451 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-aa3e1433-63cf-455d-8659-3925e38af4fe req-0835a87a-a22c-4617-9053-73a6ca59d314 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044946 Jun 03 13:24:55.278062 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 515/1038] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:24:55.959508 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-9f796b4e-fdfd-40e9-953d-476b2197c1de tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:55.960351 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-9f796b4e-fdfd-40e9-953d-476b2197c1de tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:55.969718 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f796b4e-fdfd-40e9-953d-476b2197c1de tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:55.970207 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f796b4e-fdfd-40e9-953d-476b2197c1de tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:55.970980 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f796b4e-fdfd-40e9-953d-476b2197c1de tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:55.971418 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-9f796b4e-fdfd-40e9-953d-476b2197c1de tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:56.107889 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-9f796b4e-fdfd-40e9-953d-476b2197c1de tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c829393baab4e1a827604a57944e204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19046007a41440fb351a8b44c30c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:56.115647 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-9f796b4e-fdfd-40e9-953d-476b2197c1de tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 200 len: 1315 microversion: 2.1 time: 0.162884 Jun 03 13:24:56.116223 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 524/1039] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:55 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:57.138543 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-1367a236-7b34-4ab6-9e16-0532374263b8 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:57.139296 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-1367a236-7b34-4ab6-9e16-0532374263b8 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:57.146821 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1367a236-7b34-4ab6-9e16-0532374263b8 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:57.147314 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1367a236-7b34-4ab6-9e16-0532374263b8 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:57.148151 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1367a236-7b34-4ab6-9e16-0532374263b8 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:57.148623 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-1367a236-7b34-4ab6-9e16-0532374263b8 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:57.292444 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-1367a236-7b34-4ab6-9e16-0532374263b8 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c829393baab4e1a827604a57944e204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19046007a41440fb351a8b44c30c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:57.300864 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-1367a236-7b34-4ab6-9e16-0532374263b8 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 200 len: 1315 microversion: 2.1 time: 0.169828 Jun 03 13:24:57.301438 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 516/1040] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:57 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:58.322283 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-80893234-6a78-4beb-bfb1-257912fc0515 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:58.323292 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-80893234-6a78-4beb-bfb1-257912fc0515 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:58.334562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80893234-6a78-4beb-bfb1-257912fc0515 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:58.335324 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80893234-6a78-4beb-bfb1-257912fc0515 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:58.336668 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80893234-6a78-4beb-bfb1-257912fc0515 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:58.337403 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-80893234-6a78-4beb-bfb1-257912fc0515 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:58.481381 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-80893234-6a78-4beb-bfb1-257912fc0515 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c829393baab4e1a827604a57944e204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19046007a41440fb351a8b44c30c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:58.494055 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-80893234-6a78-4beb-bfb1-257912fc0515 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 200 len: 1315 microversion: 2.1 time: 0.178103 Jun 03 13:24:58.495006 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 525/1041] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:58 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:24:59.515689 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-549df53a-5c26-41f1-8b8c-fcfd11069082 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:24:59.516273 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-549df53a-5c26-41f1-8b8c-fcfd11069082 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:24:59.523056 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-549df53a-5c26-41f1-8b8c-fcfd11069082 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:59.523498 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-549df53a-5c26-41f1-8b8c-fcfd11069082 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:59.524255 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-549df53a-5c26-41f1-8b8c-fcfd11069082 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:24:59.524645 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-549df53a-5c26-41f1-8b8c-fcfd11069082 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:24:59.666251 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-549df53a-5c26-41f1-8b8c-fcfd11069082 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c829393baab4e1a827604a57944e204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19046007a41440fb351a8b44c30c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:24:59.674426 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-549df53a-5c26-41f1-8b8c-fcfd11069082 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 200 len: 1315 microversion: 2.1 time: 0.164353 Jun 03 13:24:59.674995 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 517/1042] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:24:59 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:00.179297 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-1261906f-559a-4850-8e2d-cbc5170d3a73 req-b38b71ef-08ac-4107-bf2e-f46366ca92bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5da70b1-d9c0-4123-a86b-b452394c1804", "name": "network-vif-plugged", "status": "completed", "tag": "86ae5d43-ca46-4e1f-a9c4-c3777d030874"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:00.188747 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1261906f-559a-4850-8e2d-cbc5170d3a73 req-b38b71ef-08ac-4107-bf2e-f46366ca92bd service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:00.189296 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-1261906f-559a-4850-8e2d-cbc5170d3a73 req-b38b71ef-08ac-4107-bf2e-f46366ca92bd service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:00.202066 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-1261906f-559a-4850-8e2d-cbc5170d3a73 req-b38b71ef-08ac-4107-bf2e-f46366ca92bd service nova] Creating event network-vif-plugged:86ae5d43-ca46-4e1f-a9c4-c3777d030874 for instance e5da70b1-d9c0-4123-a86b-b452394c1804 on hv-cinder-77954 Jun 03 13:25:00.207179 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-1261906f-559a-4850-8e2d-cbc5170d3a73 req-b38b71ef-08ac-4107-bf2e-f46366ca92bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031914 Jun 03 13:25:00.208021 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 526/1043] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:00.692686 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-361ead30-f3fd-4519-8bc2-d4c1d89eff21 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:00.693263 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-361ead30-f3fd-4519-8bc2-d4c1d89eff21 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:00.700362 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-361ead30-f3fd-4519-8bc2-d4c1d89eff21 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:00.700964 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-361ead30-f3fd-4519-8bc2-d4c1d89eff21 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:00.701733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-361ead30-f3fd-4519-8bc2-d4c1d89eff21 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:00.702178 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-361ead30-f3fd-4519-8bc2-d4c1d89eff21 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:00.833261 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-361ead30-f3fd-4519-8bc2-d4c1d89eff21 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c829393baab4e1a827604a57944e204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19046007a41440fb351a8b44c30c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:00.846160 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-361ead30-f3fd-4519-8bc2-d4c1d89eff21 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 200 len: 1315 microversion: 2.1 time: 0.157249 Jun 03 13:25:00.847010 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 518/1044] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:00 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:01.872537 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-02e26e43-ba12-4c7c-8f11-c3c59d506d3c tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:01.873652 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-02e26e43-ba12-4c7c-8f11-c3c59d506d3c tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:01.886526 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-02e26e43-ba12-4c7c-8f11-c3c59d506d3c tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:01.887286 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-02e26e43-ba12-4c7c-8f11-c3c59d506d3c tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:01.888561 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-02e26e43-ba12-4c7c-8f11-c3c59d506d3c tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:01.889004 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-02e26e43-ba12-4c7c-8f11-c3c59d506d3c tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:02.041423 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-02e26e43-ba12-4c7c-8f11-c3c59d506d3c tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c829393baab4e1a827604a57944e204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19046007a41440fb351a8b44c30c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:02.049534 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-02e26e43-ba12-4c7c-8f11-c3c59d506d3c tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 200 len: 1315 microversion: 2.1 time: 0.184746 Jun 03 13:25:02.050172 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 527/1045] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:01 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:02.136695 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:25:02.137189 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Fri Jun 3 13:25:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:25:03.068524 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5dc6bac3-ff8e-44a9-bb8f-d3537b550d6a tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:03.069191 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5dc6bac3-ff8e-44a9-bb8f-d3537b550d6a tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:03.072020 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:03.072821 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=6 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:03.079587 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5dc6bac3-ff8e-44a9-bb8f-d3537b550d6a tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:03.080032 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5dc6bac3-ff8e-44a9-bb8f-d3537b550d6a tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:03.080801 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5dc6bac3-ff8e-44a9-bb8f-d3537b550d6a tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:03.081221 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5dc6bac3-ff8e-44a9-bb8f-d3537b550d6a tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:03.214474 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5dc6bac3-ff8e-44a9-bb8f-d3537b550d6a tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c829393baab4e1a827604a57944e204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19046007a41440fb351a8b44c30c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:03.222494 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5dc6bac3-ff8e-44a9-bb8f-d3537b550d6a tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 200 len: 1465 microversion: 2.1 time: 0.158914 Jun 03 13:25:03.223062 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 519/1046] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:03 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 1465 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:03.262560 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c8970f2a-11fb-441c-993a-ae088aea0de1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:03.263047 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c8970f2a-11fb-441c-993a-ae088aea0de1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:03.265355 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:03.271323 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8970f2a-11fb-441c-993a-ae088aea0de1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:03.271782 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8970f2a-11fb-441c-993a-ae088aea0de1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:03.272598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8970f2a-11fb-441c-993a-ae088aea0de1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:03.273038 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c8970f2a-11fb-441c-993a-ae088aea0de1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:03.300542 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c8970f2a-11fb-441c-993a-ae088aea0de1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:25:03.400581 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c8970f2a-11fb-441c-993a-ae088aea0de1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 204 len: 0 microversion: 2.1 time: 0.141593 Jun 03 13:25:03.401261 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 528/1047] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:25:03 2022] DELETE /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:25:03.410339 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-c37d50ee-aca3-4bf0-8749-43b07ee6df54 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:03.410955 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-c37d50ee-aca3-4bf0-8749-43b07ee6df54 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:03.417412 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c37d50ee-aca3-4bf0-8749-43b07ee6df54 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:03.417843 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c37d50ee-aca3-4bf0-8749-43b07ee6df54 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:03.418662 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c37d50ee-aca3-4bf0-8749-43b07ee6df54 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:03.419088 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-c37d50ee-aca3-4bf0-8749-43b07ee6df54 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:03.552186 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-c37d50ee-aca3-4bf0-8749-43b07ee6df54 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c829393baab4e1a827604a57944e204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19046007a41440fb351a8b44c30c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:03.560019 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-c37d50ee-aca3-4bf0-8749-43b07ee6df54 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 200 len: 1471 microversion: 2.1 time: 0.153746 Jun 03 13:25:03.560699 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 520/1048] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:03 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:04.578494 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-81d93c5a-5302-481b-88c1-38023f3068e1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:04.579195 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-81d93c5a-5302-481b-88c1-38023f3068e1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:04.586059 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81d93c5a-5302-481b-88c1-38023f3068e1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:04.586547 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81d93c5a-5302-481b-88c1-38023f3068e1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:04.587355 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81d93c5a-5302-481b-88c1-38023f3068e1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:04.587788 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-81d93c5a-5302-481b-88c1-38023f3068e1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:04.726135 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-81d93c5a-5302-481b-88c1-38023f3068e1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c829393baab4e1a827604a57944e204', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19046007a41440fb351a8b44c30c4f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:04.735614 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-81d93c5a-5302-481b-88c1-38023f3068e1 tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 200 len: 1471 microversion: 2.1 time: 0.161557 Jun 03 13:25:04.736193 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 529/1049] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:04 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:05.302851 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-20379e1f-309c-4753-a3bb-b3ffedaba935 req-4aca754c-40d6-4ac1-91a0-3c987d5b0d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5da70b1-d9c0-4123-a86b-b452394c1804", "name": "network-vif-deleted", "tag": "86ae5d43-ca46-4e1f-a9c4-c3777d030874"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:05.313702 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-20379e1f-309c-4753-a3bb-b3ffedaba935 req-4aca754c-40d6-4ac1-91a0-3c987d5b0d42 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:05.314435 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-20379e1f-309c-4753-a3bb-b3ffedaba935 req-4aca754c-40d6-4ac1-91a0-3c987d5b0d42 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:05.338652 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-20379e1f-309c-4753-a3bb-b3ffedaba935 req-4aca754c-40d6-4ac1-91a0-3c987d5b0d42 service nova] Creating event network-vif-deleted:86ae5d43-ca46-4e1f-a9c4-c3777d030874 for instance e5da70b1-d9c0-4123-a86b-b452394c1804 on hv-cinder-77954 Jun 03 13:25:05.344493 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-20379e1f-309c-4753-a3bb-b3ffedaba935 req-4aca754c-40d6-4ac1-91a0-3c987d5b0d42 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045469 Jun 03 13:25:05.345109 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 521/1050] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:05.753700 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0064e4a9-d28c-4f1d-b3e4-43a4253bbabd tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:05.754641 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0064e4a9-d28c-4f1d-b3e4-43a4253bbabd tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] [instance: e5da70b1-d9c0-4123-a86b-b452394c1804] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:05.761000 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0064e4a9-d28c-4f1d-b3e4-43a4253bbabd tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:05.761452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0064e4a9-d28c-4f1d-b3e4-43a4253bbabd tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:05.762261 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0064e4a9-d28c-4f1d-b3e4-43a4253bbabd tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:05.762705 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0064e4a9-d28c-4f1d-b3e4-43a4253bbabd tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:05.776163 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.wsgi [None req-0064e4a9-d28c-4f1d-b3e4-43a4253bbabd tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] HTTP exception thrown: Instance e5da70b1-d9c0-4123-a86b-b452394c1804 could not be found. Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0064e4a9-d28c-4f1d-b3e4-43a4253bbabd tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Request method failure captured: Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: request: GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 HTTP/1.1 Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept: application/json Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Accept-Encoding: identity Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Connection: close Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Length: 0 Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Content-Type: application/json Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Host: 10.222.0.58 Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Openstack-System-Scope: None Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: User-Agent: python-urllib3/1.26.9 Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Auth-Token: gAAAAABimguilxgG-2FC5FC77i3hGTK9lQtviNHUQ8RYSnWF_uNARIhavoHyNd1wNAPEgHU5N2rJ9fgs9m1pOnH9W47vHURX6z4b4L_XLh8zKHuWXUmy3HbCPxXkiVNxd1PnTo2fvhOGJ4ZLohB8Ng4lBqYt62BqI3ckvhHECYltrV7Jvf4nY2w Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Id: None Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Domain-Name: None Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Identity-Status: Confirmed Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Is-Admin-Project: True Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Id: default Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Domain-Name: Default Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Id: e19046007a41440fb351a8b44c30c4f2 Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Project-Name: tempest-VolumesNegativeTest-1387098589 Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Role: member,reader Jun 03 13:25:05.777821 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Roles: member,reader Jun 03 13:25:05.779664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e19046007a41440fb351a8b44c30c4f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e19046007a41440fb351a8b44c30c4f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e19046007a41440fb351a8b44c30c4f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e19046007a41440fb351a8b44c30c4f2"}]}] Jun 03 13:25:05.779664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant: tempest-VolumesNegativeTest-1387098589 Jun 03 13:25:05.779664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Id: e19046007a41440fb351a8b44c30c4f2 Jun 03 13:25:05.779664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-Tenant-Name: tempest-VolumesNegativeTest-1387098589 Jun 03 13:25:05.779664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User: tempest-VolumesNegativeTest-1387098589-project Jun 03 13:25:05.779664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Id: default Jun 03 13:25:05.779664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Domain-Name: Default Jun 03 13:25:05.779664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Id: 6c829393baab4e1a827604a57944e204 Jun 03 13:25:05.779664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: X-User-Name: tempest-VolumesNegativeTest-1387098589-project Jun 03 13:25:05.779664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: method: > Jun 03 13:25:05.779664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: exception: Instance e5da70b1-d9c0-4123-a86b-b452394c1804 could not be found. Jun 03 13:25:05.779664 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: action_args: {'id': 'e5da70b1-d9c0-4123-a86b-b452394c1804'} Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5da70b1-d9c0-4123-a86b-b452394c1804 could not be found. Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:25:05.780520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5da70b1-d9c0-4123-a86b-b452394c1804 could not be found. Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5da70b1-d9c0-4123-a86b-b452394c1804 could not be found. Jun 03 13:25:05.781943 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR nova.api.openstack.wsgi Jun 03 13:25:05.785467 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0064e4a9-d28c-4f1d-b3e4-43a4253bbabd tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] Returning 404 to user: Instance e5da70b1-d9c0-4123-a86b-b452394c1804 could not be found. {{(pid=117727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:25:05.785467 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0064e4a9-d28c-4f1d-b3e4-43a4253bbabd tempest-VolumesNegativeTest-1387098589 tempest-VolumesNegativeTest-1387098589-project] 10.222.0.58 "GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804" status: 404 len: 111 microversion: 2.1 time: 0.029588 Jun 03 13:25:05.785467 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 530/1051] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:05 2022] GET /compute/v2.1/servers/e5da70b1-d9c0-4123-a86b-b452394c1804 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:25:20.101646 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:20.102950 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=42 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:20.279738 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7ae976a8-593d-4b93-b239-250ce658e2b6 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Action: 'create', calling method: .version_select at 0x7fc5a4edfee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2129754850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM/2x01hrXeOC2NNtd67ZVYemdTQSxTHB91CWFMANlmAMg69I/4jOt6tnNo8Ggny1X0QvxYel5P2Om4ioevQ8rBMj8wE+LHCVBa3ieGOKEGkzivJuPw16PMjwMOnW4Z2g=="}} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:20.294945 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-7ae976a8-593d-4b93-b239-250ce658e2b6 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Getting quotas for project eb24e89507a54ec080cbb570f57ae7df. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:25:20.299754 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.quota [None req-7ae976a8-593d-4b93-b239-250ce658e2b6 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Getting quotas for user 9294e649dc51425ba978e70f4635ddb6 and project eb24e89507a54ec080cbb570f57ae7df. Resources: {'key_pairs'} {{(pid=117726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:25:20.332318 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7ae976a8-593d-4b93-b239-250ce658e2b6 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.232301 Jun 03 13:25:20.333228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 522/1052] 10.222.0.58 () {60 vars in 1158 bytes} [Fri Jun 3 13:25:20 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:41.953733 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-35416092", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2129754850", "security_groups": [{"name": "tempest-secgroup-smoke-1534068234"}], "networks": [{"uuid": "24b7b979-3d99-49da-80e7-c18b0629afba"}], "block_device_mapping_v2": [{"uuid": "59ccfdda-6f7f-4445-9078-d5f4c2090f1f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:41.962199 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:41.962837 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:42.072661 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.network.neutron [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] validate_networks() for [('24b7b979-3d99-49da-80e7-c18b0629afba', None, None, None, None, None)] {{(pid=117727) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 13:25:42.464345 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Flavor limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 13:25:42.464911 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Image limits 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 13:25:42.465622 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Flavor pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 13:25:42.466258 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Image pref 0:0:0 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 13:25:42.466840 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.virt.hardware [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 13:25:42.481025 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:42.481682 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:42.482963 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:42.483576 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:42.504076 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Getting quotas for project eb24e89507a54ec080cbb570f57ae7df. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 13:25:42.508423 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.quota [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Getting quotas for user 9294e649dc51425ba978e70f4635ddb6 and project eb24e89507a54ec080cbb570f57ae7df. Resources: {'instances', 'cores', 'ram'} {{(pid=117727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 13:25:42.564420 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Going to run 1 instances... {{(pid=117727) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 13:25:42.566561 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59ccfdda-6f7f-4445-9078-d5f4c2090f1f',volume_size=None,volume_type=None)] {{(pid=117727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 13:25:42.702692 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2362640e-8928-4892-9ef6-9e025810d6a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.753068 Jun 03 13:25:42.703540 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 531/1053] 10.222.0.58 () {60 vars in 1146 bytes} [Fri Jun 3 13:25:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 13:25:42.710784 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=4 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:42.712209 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:42.716047 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ff59864c-7ccd-4802-b734-3f579704568f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:42.716851 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ff59864c-7ccd-4802-b734-3f579704568f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:42.774893 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ff59864c-7ccd-4802-b734-3f579704568f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:42.781657 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ff59864c-7ccd-4802-b734-3f579704568f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1087 microversion: 2.1 time: 0.072187 Jun 03 13:25:42.782313 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 523/1054] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:42 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:43.799245 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-3006d788-bc07-45a6-b30d-0a89bfe75033 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:43.799785 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-3006d788-bc07-45a6-b30d-0a89bfe75033 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:43.807175 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3006d788-bc07-45a6-b30d-0a89bfe75033 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:43.807633 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3006d788-bc07-45a6-b30d-0a89bfe75033 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:43.808452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3006d788-bc07-45a6-b30d-0a89bfe75033 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:43.808917 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-3006d788-bc07-45a6-b30d-0a89bfe75033 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:43.872152 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-3006d788-bc07-45a6-b30d-0a89bfe75033 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:43.880071 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-3006d788-bc07-45a6-b30d-0a89bfe75033 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1203 microversion: 2.1 time: 0.085270 Jun 03 13:25:43.880669 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 532/1055] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:43 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1203 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:44.897622 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9e008208-e0a8-4cb9-8bef-d1e13724087f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:44.898302 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9e008208-e0a8-4cb9-8bef-d1e13724087f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:44.906472 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e008208-e0a8-4cb9-8bef-d1e13724087f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:44.906902 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e008208-e0a8-4cb9-8bef-d1e13724087f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:44.907710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e008208-e0a8-4cb9-8bef-d1e13724087f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:44.908129 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9e008208-e0a8-4cb9-8bef-d1e13724087f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:45.044789 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9e008208-e0a8-4cb9-8bef-d1e13724087f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:45.055909 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9e008208-e0a8-4cb9-8bef-d1e13724087f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1259 microversion: 2.1 time: 0.162373 Jun 03 13:25:45.056902 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 524/1056] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:44 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:45.340692 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-ec8d29d1-cab3-4973-a95a-8591e697b651 req-71f927e4-f12e-4990-a379-deed37920723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9929c65e-650b-4a35-8e7e-fc7ce0c9defb", "tag": "121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:45.374084 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ec8d29d1-cab3-4973-a95a-8591e697b651 req-71f927e4-f12e-4990-a379-deed37920723 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:45.376167 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-ec8d29d1-cab3-4973-a95a-8591e697b651 req-71f927e4-f12e-4990-a379-deed37920723 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:45.390619 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-ec8d29d1-cab3-4973-a95a-8591e697b651 req-71f927e4-f12e-4990-a379-deed37920723 service nova] Creating event network-changed:121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f for instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb on hv-cinder-77954 Jun 03 13:25:45.396275 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-ec8d29d1-cab3-4973-a95a-8591e697b651 req-71f927e4-f12e-4990-a379-deed37920723 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059586 Jun 03 13:25:45.396872 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 533/1057] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:46.077111 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4a139554-86ce-4b45-a029-03ced9f11cb9 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:46.078196 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4a139554-86ce-4b45-a029-03ced9f11cb9 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:46.086309 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a139554-86ce-4b45-a029-03ced9f11cb9 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:46.086755 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a139554-86ce-4b45-a029-03ced9f11cb9 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:46.087518 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a139554-86ce-4b45-a029-03ced9f11cb9 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:46.087947 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4a139554-86ce-4b45-a029-03ced9f11cb9 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:46.223624 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4a139554-86ce-4b45-a029-03ced9f11cb9 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:46.231522 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4a139554-86ce-4b45-a029-03ced9f11cb9 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1259 microversion: 2.1 time: 0.161064 Jun 03 13:25:46.232094 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 525/1058] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:46 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:47.252349 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-487c51fc-3559-4ba4-bdb4-6d0fc89a84af tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:47.253416 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-487c51fc-3559-4ba4-bdb4-6d0fc89a84af tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:47.260861 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-487c51fc-3559-4ba4-bdb4-6d0fc89a84af tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:47.261303 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-487c51fc-3559-4ba4-bdb4-6d0fc89a84af tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:47.262077 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-487c51fc-3559-4ba4-bdb4-6d0fc89a84af tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:47.262539 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-487c51fc-3559-4ba4-bdb4-6d0fc89a84af tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:47.403024 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-487c51fc-3559-4ba4-bdb4-6d0fc89a84af tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:47.411452 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-487c51fc-3559-4ba4-bdb4-6d0fc89a84af tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1259 microversion: 2.1 time: 0.164659 Jun 03 13:25:47.412027 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 534/1059] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:47 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:48.432667 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7cb064c9-0497-4855-9681-72bba3265987 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:48.433678 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7cb064c9-0497-4855-9681-72bba3265987 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:48.444854 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cb064c9-0497-4855-9681-72bba3265987 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:48.445611 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cb064c9-0497-4855-9681-72bba3265987 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:48.446950 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cb064c9-0497-4855-9681-72bba3265987 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:48.447677 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7cb064c9-0497-4855-9681-72bba3265987 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:48.602535 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7cb064c9-0497-4855-9681-72bba3265987 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:48.610591 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7cb064c9-0497-4855-9681-72bba3265987 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1259 microversion: 2.1 time: 0.184467 Jun 03 13:25:48.611170 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 526/1060] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:48 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:49.630426 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-2fb1db94-ea7f-4bd3-89df-21627c475061 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:49.631036 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-2fb1db94-ea7f-4bd3-89df-21627c475061 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:49.637535 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fb1db94-ea7f-4bd3-89df-21627c475061 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:49.637988 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fb1db94-ea7f-4bd3-89df-21627c475061 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:49.638791 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fb1db94-ea7f-4bd3-89df-21627c475061 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:49.639227 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-2fb1db94-ea7f-4bd3-89df-21627c475061 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:49.773899 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-2fb1db94-ea7f-4bd3-89df-21627c475061 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:49.782146 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-2fb1db94-ea7f-4bd3-89df-21627c475061 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1259 microversion: 2.1 time: 0.157129 Jun 03 13:25:49.782755 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 535/1061] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:49 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:50.799462 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-735ddfcc-1760-47d0-bc94-2419bef01b8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:50.800010 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-735ddfcc-1760-47d0-bc94-2419bef01b8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:50.806633 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-735ddfcc-1760-47d0-bc94-2419bef01b8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:50.807084 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-735ddfcc-1760-47d0-bc94-2419bef01b8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:50.807888 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-735ddfcc-1760-47d0-bc94-2419bef01b8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:50.808326 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-735ddfcc-1760-47d0-bc94-2419bef01b8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:50.948217 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-735ddfcc-1760-47d0-bc94-2419bef01b8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:50.959283 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-735ddfcc-1760-47d0-bc94-2419bef01b8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1259 microversion: 2.1 time: 0.163330 Jun 03 13:25:50.960424 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 527/1062] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:50 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:51.979449 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-bd9b36b3-cd2d-480f-b117-799fe148313f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:51.980066 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-bd9b36b3-cd2d-480f-b117-799fe148313f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:51.987321 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd9b36b3-cd2d-480f-b117-799fe148313f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:51.987798 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd9b36b3-cd2d-480f-b117-799fe148313f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:51.989201 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd9b36b3-cd2d-480f-b117-799fe148313f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:51.989712 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-bd9b36b3-cd2d-480f-b117-799fe148313f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:52.135638 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-bd9b36b3-cd2d-480f-b117-799fe148313f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:52.143307 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-bd9b36b3-cd2d-480f-b117-799fe148313f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1259 microversion: 2.1 time: 0.168097 Jun 03 13:25:52.143867 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 536/1063] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:51 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:53.165271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-9b55cde3-6450-47a4-9ad0-3ef79901f823 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:53.166327 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-9b55cde3-6450-47a4-9ad0-3ef79901f823 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:53.169999 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell0:SELECT=2 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:53.178394 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b55cde3-6450-47a4-9ad0-3ef79901f823 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:53.178840 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b55cde3-6450-47a4-9ad0-3ef79901f823 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:53.179608 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b55cde3-6450-47a4-9ad0-3ef79901f823 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:53.180041 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-9b55cde3-6450-47a4-9ad0-3ef79901f823 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:53.321277 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-9b55cde3-6450-47a4-9ad0-3ef79901f823 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:53.333245 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-9b55cde3-6450-47a4-9ad0-3ef79901f823 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1259 microversion: 2.1 time: 0.175225 Jun 03 13:25:53.334093 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 528/1064] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:53 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:54.358167 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6953f921-c3a2-40c8-aa4a-5d2094bda055 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:54.359092 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6953f921-c3a2-40c8-aa4a-5d2094bda055 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:54.361249 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:54.362219 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell0:SELECT=6 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:25:54.368858 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6953f921-c3a2-40c8-aa4a-5d2094bda055 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:54.369311 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6953f921-c3a2-40c8-aa4a-5d2094bda055 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:54.370103 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6953f921-c3a2-40c8-aa4a-5d2094bda055 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:54.370557 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6953f921-c3a2-40c8-aa4a-5d2094bda055 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:54.509017 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6953f921-c3a2-40c8-aa4a-5d2094bda055 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:54.517082 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6953f921-c3a2-40c8-aa4a-5d2094bda055 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1259 microversion: 2.1 time: 0.165059 Jun 03 13:25:54.517655 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 537/1065] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:54 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:55.537945 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6c5821ba-df32-418a-adc0-858a1a00f13e tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:55.538546 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6c5821ba-df32-418a-adc0-858a1a00f13e tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:55.545707 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c5821ba-df32-418a-adc0-858a1a00f13e tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:55.546146 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c5821ba-df32-418a-adc0-858a1a00f13e tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:55.546946 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c5821ba-df32-418a-adc0-858a1a00f13e tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:55.547377 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6c5821ba-df32-418a-adc0-858a1a00f13e tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:55.685779 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-6c5821ba-df32-418a-adc0-858a1a00f13e tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:55.694101 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6c5821ba-df32-418a-adc0-858a1a00f13e tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1259 microversion: 2.1 time: 0.162204 Jun 03 13:25:55.694685 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 529/1066] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:55 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:56.435266 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:25:56.435775 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Fri Jun 3 13:25:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:25:56.482847 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [req-952bfb25-d752-480f-971a-a4257b610ec7 req-ab16e579-a22c-40e1-b7c6-cf03671a4801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9929c65e-650b-4a35-8e7e-fc7ce0c9defb", "name": "network-vif-plugged", "status": "completed", "tag": "121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f"}]} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:25:56.491857 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-952bfb25-d752-480f-971a-a4257b610ec7 req-ab16e579-a22c-40e1-b7c6-cf03671a4801 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:56.492327 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [req-952bfb25-d752-480f-971a-a4257b610ec7 req-ab16e579-a22c-40e1-b7c6-cf03671a4801 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:56.504298 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.compute.server_external_events [req-952bfb25-d752-480f-971a-a4257b610ec7 req-ab16e579-a22c-40e1-b7c6-cf03671a4801 service nova] Creating event network-vif-plugged:121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f for instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb on hv-cinder-77954 Jun 03 13:25:56.509425 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [req-952bfb25-d752-480f-971a-a4257b610ec7 req-ab16e579-a22c-40e1-b7c6-cf03671a4801 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030291 Jun 03 13:25:56.510285 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 538/1067] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:25:56.711925 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-171c168d-5484-4b85-98ec-5012b6247686 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:56.713228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-171c168d-5484-4b85-98ec-5012b6247686 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:56.719861 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-171c168d-5484-4b85-98ec-5012b6247686 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:56.720315 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-171c168d-5484-4b85-98ec-5012b6247686 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:56.721186 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-171c168d-5484-4b85-98ec-5012b6247686 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:56.721819 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-171c168d-5484-4b85-98ec-5012b6247686 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:56.868201 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-171c168d-5484-4b85-98ec-5012b6247686 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:56.879733 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-171c168d-5484-4b85-98ec-5012b6247686 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1259 microversion: 2.1 time: 0.171802 Jun 03 13:25:56.880457 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 530/1068] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:56 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:57.905996 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ae338b98-2faa-4555-8491-d9b6588de3f5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:57.906615 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ae338b98-2faa-4555-8491-d9b6588de3f5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:57.914734 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae338b98-2faa-4555-8491-d9b6588de3f5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:57.915184 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae338b98-2faa-4555-8491-d9b6588de3f5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:57.915964 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae338b98-2faa-4555-8491-d9b6588de3f5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:57.916402 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ae338b98-2faa-4555-8491-d9b6588de3f5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:58.061090 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ae338b98-2faa-4555-8491-d9b6588de3f5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:58.071623 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ae338b98-2faa-4555-8491-d9b6588de3f5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1259 microversion: 2.1 time: 0.173414 Jun 03 13:25:58.072203 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 539/1069] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:57 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:59.089814 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7859e48c-d9e6-459f-9085-5a0924605f9a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:59.090450 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7859e48c-d9e6-459f-9085-5a0924605f9a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:59.097464 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7859e48c-d9e6-459f-9085-5a0924605f9a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:59.097989 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7859e48c-d9e6-459f-9085-5a0924605f9a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:59.098810 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7859e48c-d9e6-459f-9085-5a0924605f9a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:59.099251 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7859e48c-d9e6-459f-9085-5a0924605f9a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:59.235329 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7859e48c-d9e6-459f-9085-5a0924605f9a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:59.243757 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7859e48c-d9e6-459f-9085-5a0924605f9a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1441 microversion: 2.1 time: 0.157938 Jun 03 13:25:59.244335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 531/1070] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:59 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1441 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:25:59.260247 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-7772bde0-cf21-42e8-9c04-05baf2ab2675 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:25:59.260834 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-7772bde0-cf21-42e8-9c04-05baf2ab2675 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:25:59.267776 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7772bde0-cf21-42e8-9c04-05baf2ab2675 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:59.268227 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7772bde0-cf21-42e8-9c04-05baf2ab2675 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:59.269046 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7772bde0-cf21-42e8-9c04-05baf2ab2675 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:25:59.269451 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-7772bde0-cf21-42e8-9c04-05baf2ab2675 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:25:59.403409 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-7772bde0-cf21-42e8-9c04-05baf2ab2675 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:25:59.411234 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-7772bde0-cf21-42e8-9c04-05baf2ab2675 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1441 microversion: 2.1 time: 0.154830 Jun 03 13:25:59.411792 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 540/1071] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:25:59 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1441 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:26:01.183882 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-2d9f0cbe-d650-4f62-9cdd-a899e694ed8e req-6600f06c-1ebe-4183-96a7-7cad6b540044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9929c65e-650b-4a35-8e7e-fc7ce0c9defb", "tag": "121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:26:01.193022 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-2d9f0cbe-d650-4f62-9cdd-a899e694ed8e req-6600f06c-1ebe-4183-96a7-7cad6b540044 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:26:01.193465 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-2d9f0cbe-d650-4f62-9cdd-a899e694ed8e req-6600f06c-1ebe-4183-96a7-7cad6b540044 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:26:01.204393 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-2d9f0cbe-d650-4f62-9cdd-a899e694ed8e req-6600f06c-1ebe-4183-96a7-7cad6b540044 service nova] Creating event network-changed:121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f for instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb on hv-cinder-77954 Jun 03 13:26:01.209587 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-2d9f0cbe-d650-4f62-9cdd-a899e694ed8e req-6600f06c-1ebe-4183-96a7-7cad6b540044 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029455 Jun 03 13:26:01.210311 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 532/1072] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:27:23.657975 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:27:23.658849 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Fri Jun 3 13:27:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:28:15.310383 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65e936ae-5aa3-453d-bc67-3448a25bdbd4] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 03 13:28:15.311717 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:15.312890 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=48 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:15.318429 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-a305f6e9-4686-4a95-b951-d50ee97fbba5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:15.318965 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-a305f6e9-4686-4a95-b951-d50ee97fbba5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:15.326704 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a305f6e9-4686-4a95-b951-d50ee97fbba5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:15.327157 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a305f6e9-4686-4a95-b951-d50ee97fbba5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:15.327944 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a305f6e9-4686-4a95-b951-d50ee97fbba5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:15.328385 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-a305f6e9-4686-4a95-b951-d50ee97fbba5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:15.350999 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.objects.instance [None req-a305f6e9-4686-4a95-b951-d50ee97fbba5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lazy-loading 'flavor' on Instance uuid 9929c65e-650b-4a35-8e7e-fc7ce0c9defb {{(pid=117727) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 13:28:15.430671 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-a305f6e9-4686-4a95-b951-d50ee97fbba5 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "POST /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb/action" status: 202 len: 0 microversion: 2.1 time: 0.123481 Jun 03 13:28:15.431175 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 541/1073] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:28:15 2022] POST /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:28:15.438504 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=22 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:15.439250 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=50 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:15.444670 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-769a58ae-dc2e-460a-80b6-f83e83469b00 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:15.445374 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-769a58ae-dc2e-460a-80b6-f83e83469b00 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:15.454507 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-769a58ae-dc2e-460a-80b6-f83e83469b00 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:15.454956 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-769a58ae-dc2e-460a-80b6-f83e83469b00 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:15.455955 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-769a58ae-dc2e-460a-80b6-f83e83469b00 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:15.456391 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-769a58ae-dc2e-460a-80b6-f83e83469b00 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:15.694142 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-769a58ae-dc2e-460a-80b6-f83e83469b00 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:15.702415 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-769a58ae-dc2e-460a-80b6-f83e83469b00 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.265962 Jun 03 13:28:15.702954 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 533/1074] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:15 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:16.721566 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-fa52f071-9d1a-4257-930e-6e00e12515a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:16.722295 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-fa52f071-9d1a-4257-930e-6e00e12515a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:16.729441 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa52f071-9d1a-4257-930e-6e00e12515a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:16.729914 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa52f071-9d1a-4257-930e-6e00e12515a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:16.730724 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa52f071-9d1a-4257-930e-6e00e12515a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:16.731149 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-fa52f071-9d1a-4257-930e-6e00e12515a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:16.736463 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] [65e936ae-5aa3-453d-bc67-3448a25bdbd4] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 35324. Jun 03 13:28:16.931313 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-fa52f071-9d1a-4257-930e-6e00e12515a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:16.943562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-fa52f071-9d1a-4257-930e-6e00e12515a3 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.227053 Jun 03 13:28:16.944413 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 542/1075] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:16 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:17.970836 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-8157ce94-2e48-4da5-8482-6eaaf8d74c91 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:17.971806 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-8157ce94-2e48-4da5-8482-6eaaf8d74c91 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:17.980177 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8157ce94-2e48-4da5-8482-6eaaf8d74c91 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:17.980632 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8157ce94-2e48-4da5-8482-6eaaf8d74c91 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:17.981411 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8157ce94-2e48-4da5-8482-6eaaf8d74c91 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:17.981846 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-8157ce94-2e48-4da5-8482-6eaaf8d74c91 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:18.136179 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-8157ce94-2e48-4da5-8482-6eaaf8d74c91 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:18.144190 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-8157ce94-2e48-4da5-8482-6eaaf8d74c91 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.180008 Jun 03 13:28:18.144735 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 534/1076] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:17 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:19.161738 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-888d83c6-ac0c-447d-a9e1-cf7026fa26a7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:19.162494 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-888d83c6-ac0c-447d-a9e1-cf7026fa26a7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:19.170075 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-888d83c6-ac0c-447d-a9e1-cf7026fa26a7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:19.170613 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-888d83c6-ac0c-447d-a9e1-cf7026fa26a7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:19.171476 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-888d83c6-ac0c-447d-a9e1-cf7026fa26a7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:19.171966 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-888d83c6-ac0c-447d-a9e1-cf7026fa26a7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:19.311219 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-888d83c6-ac0c-447d-a9e1-cf7026fa26a7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:19.319258 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-888d83c6-ac0c-447d-a9e1-cf7026fa26a7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.161907 Jun 03 13:28:19.319830 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 543/1077] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:19 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:20.341192 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-54d17989-7c93-4bd8-a4e5-aabf76d09065 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:20.342286 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-54d17989-7c93-4bd8-a4e5-aabf76d09065 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:20.351774 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54d17989-7c93-4bd8-a4e5-aabf76d09065 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:20.352226 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54d17989-7c93-4bd8-a4e5-aabf76d09065 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:20.353002 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54d17989-7c93-4bd8-a4e5-aabf76d09065 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:20.353440 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-54d17989-7c93-4bd8-a4e5-aabf76d09065 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:20.485150 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-54d17989-7c93-4bd8-a4e5-aabf76d09065 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:20.493094 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-54d17989-7c93-4bd8-a4e5-aabf76d09065 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.159068 Jun 03 13:28:20.493666 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 535/1078] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:20 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:21.513486 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-89ddfe8c-64f0-4b26-bf74-b105f01711a4 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:21.513486 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-89ddfe8c-64f0-4b26-bf74-b105f01711a4 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:21.521270 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89ddfe8c-64f0-4b26-bf74-b105f01711a4 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:21.521727 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89ddfe8c-64f0-4b26-bf74-b105f01711a4 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:21.522785 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89ddfe8c-64f0-4b26-bf74-b105f01711a4 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:21.523226 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-89ddfe8c-64f0-4b26-bf74-b105f01711a4 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:21.677918 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-89ddfe8c-64f0-4b26-bf74-b105f01711a4 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:21.686941 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-89ddfe8c-64f0-4b26-bf74-b105f01711a4 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.180170 Jun 03 13:28:21.687513 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 544/1079] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:21 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:22.147344 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:28:22.148041 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Fri Jun 3 13:28:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:28:22.704643 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-93d6b56b-6853-43fe-9f8d-1fe2f9506768 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:22.705258 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-93d6b56b-6853-43fe-9f8d-1fe2f9506768 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:22.712271 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-93d6b56b-6853-43fe-9f8d-1fe2f9506768 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:22.712725 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-93d6b56b-6853-43fe-9f8d-1fe2f9506768 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:22.713534 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-93d6b56b-6853-43fe-9f8d-1fe2f9506768 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:22.713967 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-93d6b56b-6853-43fe-9f8d-1fe2f9506768 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:22.858772 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-93d6b56b-6853-43fe-9f8d-1fe2f9506768 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:22.866977 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-93d6b56b-6853-43fe-9f8d-1fe2f9506768 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.166363 Jun 03 13:28:22.867579 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 536/1080] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:22 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:23.889178 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6416b68e-2232-4543-9359-12c44166d3ea tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:23.890056 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6416b68e-2232-4543-9359-12c44166d3ea tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:23.901158 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6416b68e-2232-4543-9359-12c44166d3ea tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:23.901918 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6416b68e-2232-4543-9359-12c44166d3ea tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:23.903263 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6416b68e-2232-4543-9359-12c44166d3ea tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:23.903994 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6416b68e-2232-4543-9359-12c44166d3ea tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:24.051350 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6416b68e-2232-4543-9359-12c44166d3ea tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:24.059728 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6416b68e-2232-4543-9359-12c44166d3ea tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.177434 Jun 03 13:28:24.060302 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 545/1081] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:23 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:25.083134 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-7d7dda89-229c-4604-9063-0b2ce1b6ba41 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:25.084192 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-7d7dda89-229c-4604-9063-0b2ce1b6ba41 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:25.092633 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7d7dda89-229c-4604-9063-0b2ce1b6ba41 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:25.093106 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7d7dda89-229c-4604-9063-0b2ce1b6ba41 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:25.093926 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7d7dda89-229c-4604-9063-0b2ce1b6ba41 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:25.094415 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-7d7dda89-229c-4604-9063-0b2ce1b6ba41 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:25.238486 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-7d7dda89-229c-4604-9063-0b2ce1b6ba41 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:25.251025 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-7d7dda89-229c-4604-9063-0b2ce1b6ba41 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.171794 Jun 03 13:28:25.251931 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 537/1082] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:25 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:26.272864 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-afbd324e-4164-4719-845e-e54b00984e69 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:26.273803 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-afbd324e-4164-4719-845e-e54b00984e69 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:26.280287 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-afbd324e-4164-4719-845e-e54b00984e69 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:26.280733 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-afbd324e-4164-4719-845e-e54b00984e69 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:26.281495 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-afbd324e-4164-4719-845e-e54b00984e69 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:26.281924 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-afbd324e-4164-4719-845e-e54b00984e69 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:26.415685 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-afbd324e-4164-4719-845e-e54b00984e69 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:26.426852 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-afbd324e-4164-4719-845e-e54b00984e69 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.160131 Jun 03 13:28:26.427563 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 546/1083] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:26 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:27.448214 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-4b2d9e85-e068-4eac-89d8-93322da620fb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:27.448851 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-4b2d9e85-e068-4eac-89d8-93322da620fb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:27.456567 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b2d9e85-e068-4eac-89d8-93322da620fb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:27.457073 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b2d9e85-e068-4eac-89d8-93322da620fb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:27.457924 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b2d9e85-e068-4eac-89d8-93322da620fb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:27.458448 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-4b2d9e85-e068-4eac-89d8-93322da620fb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:27.602542 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-4b2d9e85-e068-4eac-89d8-93322da620fb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:27.610760 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-4b2d9e85-e068-4eac-89d8-93322da620fb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.168367 Jun 03 13:28:27.611335 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 538/1084] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:27 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 13:28:28.632284 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ef2a89a4-bf03-4af2-84f9-594f07ebd3c8 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:28.633316 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ef2a89a4-bf03-4af2-84f9-594f07ebd3c8 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:28.644949 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef2a89a4-bf03-4af2-84f9-594f07ebd3c8 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:28.645692 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef2a89a4-bf03-4af2-84f9-594f07ebd3c8 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:28.647002 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef2a89a4-bf03-4af2-84f9-594f07ebd3c8 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:28.647726 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ef2a89a4-bf03-4af2-84f9-594f07ebd3c8 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:28.789351 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ef2a89a4-bf03-4af2-84f9-594f07ebd3c8 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:28.797984 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ef2a89a4-bf03-4af2-84f9-594f07ebd3c8 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.172307 Jun 03 13:28:28.798523 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 547/1085] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:28 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:29.821175 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-5c71c03b-277b-4221-b6b8-49fbafd11a13 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:29.821797 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-5c71c03b-277b-4221-b6b8-49fbafd11a13 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:29.829268 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c71c03b-277b-4221-b6b8-49fbafd11a13 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:29.829759 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c71c03b-277b-4221-b6b8-49fbafd11a13 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:29.830586 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c71c03b-277b-4221-b6b8-49fbafd11a13 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:29.831046 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-5c71c03b-277b-4221-b6b8-49fbafd11a13 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:29.971634 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-5c71c03b-277b-4221-b6b8-49fbafd11a13 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:29.979984 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-5c71c03b-277b-4221-b6b8-49fbafd11a13 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.165780 Jun 03 13:28:29.980832 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 539/1086] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:29 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:30.997598 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-0ca1e8c6-065d-483a-8257-38d7277fc48a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:30.998216 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-0ca1e8c6-065d-483a-8257-38d7277fc48a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:31.005112 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0ca1e8c6-065d-483a-8257-38d7277fc48a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:31.005562 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0ca1e8c6-065d-483a-8257-38d7277fc48a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:31.006389 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0ca1e8c6-065d-483a-8257-38d7277fc48a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:31.006808 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-0ca1e8c6-065d-483a-8257-38d7277fc48a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:31.141543 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-0ca1e8c6-065d-483a-8257-38d7277fc48a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:31.149447 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-0ca1e8c6-065d-483a-8257-38d7277fc48a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.156202 Jun 03 13:28:31.150027 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 548/1087] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:30 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:32.170428 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-f532e25a-435f-4c46-b0ae-48b48dcfef54 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:32.171485 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-f532e25a-435f-4c46-b0ae-48b48dcfef54 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:32.181639 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f532e25a-435f-4c46-b0ae-48b48dcfef54 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:32.182468 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f532e25a-435f-4c46-b0ae-48b48dcfef54 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:32.182998 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f532e25a-435f-4c46-b0ae-48b48dcfef54 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:32.183473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-f532e25a-435f-4c46-b0ae-48b48dcfef54 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:32.321644 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-f532e25a-435f-4c46-b0ae-48b48dcfef54 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:32.333751 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-f532e25a-435f-4c46-b0ae-48b48dcfef54 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.169531 Jun 03 13:28:32.334505 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 540/1088] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:32 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:33.352996 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-663fa247-9496-4458-9cc3-0eb885e5ec59 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:33.353695 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-663fa247-9496-4458-9cc3-0eb885e5ec59 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:33.361778 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-663fa247-9496-4458-9cc3-0eb885e5ec59 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:33.362259 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-663fa247-9496-4458-9cc3-0eb885e5ec59 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:33.363013 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-663fa247-9496-4458-9cc3-0eb885e5ec59 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:33.363451 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-663fa247-9496-4458-9cc3-0eb885e5ec59 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:33.501430 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-663fa247-9496-4458-9cc3-0eb885e5ec59 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:33.509232 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-663fa247-9496-4458-9cc3-0eb885e5ec59 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1566 microversion: 2.1 time: 0.160498 Jun 03 13:28:33.509803 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 549/1089] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:33 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:33.530994 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b7bc76f7-4a8e-4a82-8804-874e3c7e973a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:33.531761 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b7bc76f7-4a8e-4a82-8804-874e3c7e973a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:33.538859 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b7bc76f7-4a8e-4a82-8804-874e3c7e973a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:33.539307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b7bc76f7-4a8e-4a82-8804-874e3c7e973a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:33.540110 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b7bc76f7-4a8e-4a82-8804-874e3c7e973a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:33.540541 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b7bc76f7-4a8e-4a82-8804-874e3c7e973a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:33.687110 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b7bc76f7-4a8e-4a82-8804-874e3c7e973a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "POST /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb/action" status: 202 len: 0 microversion: 2.1 time: 0.160573 Jun 03 13:28:33.687685 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 541/1090] 10.222.0.58 () {60 vars in 1277 bytes} [Fri Jun 3 13:28:33 2022] POST /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:28:33.696274 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6dfc30c1-9cb6-4c7d-9f58-dd8b06f7789f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:33.697162 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6dfc30c1-9cb6-4c7d-9f58-dd8b06f7789f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:33.703558 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6dfc30c1-9cb6-4c7d-9f58-dd8b06f7789f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:33.704011 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6dfc30c1-9cb6-4c7d-9f58-dd8b06f7789f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:33.704794 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6dfc30c1-9cb6-4c7d-9f58-dd8b06f7789f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:33.705231 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6dfc30c1-9cb6-4c7d-9f58-dd8b06f7789f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:33.841576 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6dfc30c1-9cb6-4c7d-9f58-dd8b06f7789f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:33.849574 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6dfc30c1-9cb6-4c7d-9f58-dd8b06f7789f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1514 microversion: 2.1 time: 0.157394 Jun 03 13:28:33.850344 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 550/1091] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:33 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:34.867520 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-2e3ad2d8-0e13-4091-b457-f666830daaa1 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:34.868117 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-2e3ad2d8-0e13-4091-b457-f666830daaa1 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:34.875254 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e3ad2d8-0e13-4091-b457-f666830daaa1 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:34.875699 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e3ad2d8-0e13-4091-b457-f666830daaa1 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:34.876473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e3ad2d8-0e13-4091-b457-f666830daaa1 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:34.876915 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-2e3ad2d8-0e13-4091-b457-f666830daaa1 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:35.013698 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-2e3ad2d8-0e13-4091-b457-f666830daaa1 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:35.021307 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-2e3ad2d8-0e13-4091-b457-f666830daaa1 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1516 microversion: 2.1 time: 0.158256 Jun 03 13:28:35.021874 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 542/1092] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:34 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:36.043359 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-119c9771-b462-4d38-9b78-b4853074d839 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:36.044459 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-119c9771-b462-4d38-9b78-b4853074d839 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:36.055459 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-119c9771-b462-4d38-9b78-b4853074d839 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:36.056210 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-119c9771-b462-4d38-9b78-b4853074d839 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:36.057489 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-119c9771-b462-4d38-9b78-b4853074d839 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:36.058314 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-119c9771-b462-4d38-9b78-b4853074d839 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:36.201811 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-119c9771-b462-4d38-9b78-b4853074d839 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:36.209996 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-119c9771-b462-4d38-9b78-b4853074d839 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1572 microversion: 2.1 time: 0.173387 Jun 03 13:28:36.210572 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 551/1093] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:36 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1572 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:37.226508 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-d9f55df4-df7a-4d38-8f92-9b4912a26a25 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:37.227208 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-d9f55df4-df7a-4d38-8f92-9b4912a26a25 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:37.235125 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9f55df4-df7a-4d38-8f92-9b4912a26a25 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.235702 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9f55df4-df7a-4d38-8f92-9b4912a26a25 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.236616 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9f55df4-df7a-4d38-8f92-9b4912a26a25 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.237220 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-d9f55df4-df7a-4d38-8f92-9b4912a26a25 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.253710 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-04e72d8a-5fc8-4c40-b183-1b002a52ef2d req-91cacb16-4771-481e-8164-f07c70c42265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9929c65e-650b-4a35-8e7e-fc7ce0c9defb", "name": "network-vif-unplugged", "status": "completed", "tag": "121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:37.264024 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-04e72d8a-5fc8-4c40-b183-1b002a52ef2d req-91cacb16-4771-481e-8164-f07c70c42265 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:37.264473 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-04e72d8a-5fc8-4c40-b183-1b002a52ef2d req-91cacb16-4771-481e-8164-f07c70c42265 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:37.276071 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-04e72d8a-5fc8-4c40-b183-1b002a52ef2d req-91cacb16-4771-481e-8164-f07c70c42265 service nova] Creating event network-vif-unplugged:121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f for instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb on hv-cinder-77954 Jun 03 13:28:37.281371 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-04e72d8a-5fc8-4c40-b183-1b002a52ef2d req-91cacb16-4771-481e-8164-f07c70c42265 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101843 Jun 03 13:28:37.282000 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 543/1094] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:37.377851 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-d9f55df4-df7a-4d38-8f92-9b4912a26a25 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:37.389103 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-d9f55df4-df7a-4d38-8f92-9b4912a26a25 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1572 microversion: 2.1 time: 0.166269 Jun 03 13:28:37.389841 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 552/1095] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:37 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1572 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:38.412645 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-0de35629-1c51-4e0c-99b0-fa04d441c0cd tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:38.413233 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-0de35629-1c51-4e0c-99b0-fa04d441c0cd tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:38.420708 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0de35629-1c51-4e0c-99b0-fa04d441c0cd tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:38.421163 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0de35629-1c51-4e0c-99b0-fa04d441c0cd tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:38.421941 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0de35629-1c51-4e0c-99b0-fa04d441c0cd tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:38.422403 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-0de35629-1c51-4e0c-99b0-fa04d441c0cd tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:38.571949 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-0de35629-1c51-4e0c-99b0-fa04d441c0cd tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:38.580070 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-0de35629-1c51-4e0c-99b0-fa04d441c0cd tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1572 microversion: 2.1 time: 0.172704 Jun 03 13:28:38.580643 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 544/1096] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:38 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1572 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:39.601455 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-63f76ee1-ab26-4112-9fdb-f6c7c3cfd04c tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:39.602539 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-63f76ee1-ab26-4112-9fdb-f6c7c3cfd04c tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:39.613830 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63f76ee1-ab26-4112-9fdb-f6c7c3cfd04c tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:39.614623 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63f76ee1-ab26-4112-9fdb-f6c7c3cfd04c tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:39.615914 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63f76ee1-ab26-4112-9fdb-f6c7c3cfd04c tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:39.616772 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-63f76ee1-ab26-4112-9fdb-f6c7c3cfd04c tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:39.766311 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-63f76ee1-ab26-4112-9fdb-f6c7c3cfd04c tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:39.777927 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-63f76ee1-ab26-4112-9fdb-f6c7c3cfd04c tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1572 microversion: 2.1 time: 0.183454 Jun 03 13:28:39.778546 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 553/1097] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:39 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1572 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:40.799994 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-b78e1e97-a10e-437a-90d4-e5b7274cd25f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:40.800883 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-b78e1e97-a10e-437a-90d4-e5b7274cd25f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:40.812018 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b78e1e97-a10e-437a-90d4-e5b7274cd25f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:40.812747 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b78e1e97-a10e-437a-90d4-e5b7274cd25f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:40.814001 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b78e1e97-a10e-437a-90d4-e5b7274cd25f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:40.814760 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-b78e1e97-a10e-437a-90d4-e5b7274cd25f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:40.965312 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-b78e1e97-a10e-437a-90d4-e5b7274cd25f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:40.977143 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-b78e1e97-a10e-437a-90d4-e5b7274cd25f tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1572 microversion: 2.1 time: 0.184397 Jun 03 13:28:40.977750 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 545/1098] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:40 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1572 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:41.999143 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c0f1ab57-5070-4896-a12d-f08f25ba3fa2 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:41.999885 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c0f1ab57-5070-4896-a12d-f08f25ba3fa2 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:42.008314 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0f1ab57-5070-4896-a12d-f08f25ba3fa2 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:42.008876 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0f1ab57-5070-4896-a12d-f08f25ba3fa2 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:42.009822 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0f1ab57-5070-4896-a12d-f08f25ba3fa2 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:42.010411 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c0f1ab57-5070-4896-a12d-f08f25ba3fa2 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:42.149714 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c0f1ab57-5070-4896-a12d-f08f25ba3fa2 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:42.157837 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c0f1ab57-5070-4896-a12d-f08f25ba3fa2 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1572 microversion: 2.1 time: 0.165311 Jun 03 13:28:42.158457 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 554/1099] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:41 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:43.176255 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-ff657f16-8808-43a0-a7b6-d6816fcb8171 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:43.176975 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-ff657f16-8808-43a0-a7b6-d6816fcb8171 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:43.185358 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ff657f16-8808-43a0-a7b6-d6816fcb8171 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:43.185867 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ff657f16-8808-43a0-a7b6-d6816fcb8171 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:43.186859 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ff657f16-8808-43a0-a7b6-d6816fcb8171 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:43.187370 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-ff657f16-8808-43a0-a7b6-d6816fcb8171 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:43.338797 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-ff657f16-8808-43a0-a7b6-d6816fcb8171 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:43.346706 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-ff657f16-8808-43a0-a7b6-d6816fcb8171 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1572 microversion: 2.1 time: 0.175095 Jun 03 13:28:43.347283 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 546/1100] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:43 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1572 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:44.368707 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-6a7b7435-d22a-4819-b12b-1df3e6a1cb8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:28:44.369277 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-6a7b7435-d22a-4819-b12b-1df3e6a1cb8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:28:44.376412 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a7b7435-d22a-4819-b12b-1df3e6a1cb8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:44.376860 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a7b7435-d22a-4819-b12b-1df3e6a1cb8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:44.377628 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a7b7435-d22a-4819-b12b-1df3e6a1cb8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:44.378063 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-6a7b7435-d22a-4819-b12b-1df3e6a1cb8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:44.396247 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:44.537932 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-6a7b7435-d22a-4819-b12b-1df3e6a1cb8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:28:44.546724 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-6a7b7435-d22a-4819-b12b-1df3e6a1cb8a tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1559 microversion: 2.1 time: 0.181902 Jun 03 13:28:44.547304 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 555/1101] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:28:44 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:28:47.312960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-ab06cd0c-cdd9-45a1-ab65-07a5ae7f7ace req-44610599-e710-4847-83df-8536db1d8d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9929c65e-650b-4a35-8e7e-fc7ce0c9defb", "name": "network-vif-plugged", "status": "completed", "tag": "121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:28:47.317022 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=31 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:47.322850 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-ab06cd0c-cdd9-45a1-ab65-07a5ae7f7ace req-44610599-e710-4847-83df-8536db1d8d3f service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:28:47.323302 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-ab06cd0c-cdd9-45a1-ab65-07a5ae7f7ace req-44610599-e710-4847-83df-8536db1d8d3f service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:28:47.327574 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:28:47.335578 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-ab06cd0c-cdd9-45a1-ab65-07a5ae7f7ace req-44610599-e710-4847-83df-8536db1d8d3f service nova] Creating event network-vif-plugged:121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f for instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb on hv-cinder-77954 Jun 03 13:28:47.341803 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-ab06cd0c-cdd9-45a1-ab65-07a5ae7f7ace req-44610599-e710-4847-83df-8536db1d8d3f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032335 Jun 03 13:28:47.342454 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 547/1102] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:28:59.983869 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:28:59.984880 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Fri Jun 3 13:28:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:29:16.444873 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:29:16.446084 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Fri Jun 3 13:29:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:30:12.377741 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_api:SELECT=30 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:12.378481 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG dbcounter [-] [117727] Writing DB stats nova_cell1:SELECT=2 {{(pid=117727) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:12.384228 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG dbcounter [-] [117726] Writing DB stats nova_api:SELECT=1 {{(pid=117726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 13:30:12.393210 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-e9169d17-6e5f-4e18-ac03-c4e84cf069cb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:12.394005 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e9169d17-6e5f-4e18-ac03-c4e84cf069cb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:12.402616 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9169d17-6e5f-4e18-ac03-c4e84cf069cb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:12.403401 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9169d17-6e5f-4e18-ac03-c4e84cf069cb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:12.404263 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9169d17-6e5f-4e18-ac03-c4e84cf069cb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:12.404771 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-e9169d17-6e5f-4e18-ac03-c4e84cf069cb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:12.431904 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-e9169d17-6e5f-4e18-ac03-c4e84cf069cb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Going to try to terminate instance {{(pid=117727) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 13:30:12.448309 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-fc0d64b9-d1aa-4dfd-8495-2ee7f453b12d req-c74e3079-a917-42b1-8ba5-172aba2bbb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9929c65e-650b-4a35-8e7e-fc7ce0c9defb", "tag": "121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:12.456849 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-fc0d64b9-d1aa-4dfd-8495-2ee7f453b12d req-c74e3079-a917-42b1-8ba5-172aba2bbb39 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:12.457377 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-fc0d64b9-d1aa-4dfd-8495-2ee7f453b12d req-c74e3079-a917-42b1-8ba5-172aba2bbb39 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:12.469570 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-fc0d64b9-d1aa-4dfd-8495-2ee7f453b12d req-c74e3079-a917-42b1-8ba5-172aba2bbb39 service nova] Creating event network-changed:121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f for instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb on hv-cinder-77954 Jun 03 13:30:12.475076 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-fc0d64b9-d1aa-4dfd-8495-2ee7f453b12d req-c74e3079-a917-42b1-8ba5-172aba2bbb39 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093010 Jun 03 13:30:12.476341 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 548/1103] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:12.531520 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-e9169d17-6e5f-4e18-ac03-c4e84cf069cb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 204 len: 0 microversion: 2.1 time: 0.155347 Jun 03 13:30:12.534411 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 556/1104] 10.222.0.58 () {58 vars in 1238 bytes} [Fri Jun 3 13:30:12 2022] DELETE /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 13:30:12.547687 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-094c23a9-6b00-40ee-ae80-626e835b9f73 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:12.549186 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-094c23a9-6b00-40ee-ae80-626e835b9f73 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:12.556439 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-094c23a9-6b00-40ee-ae80-626e835b9f73 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:12.557002 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-094c23a9-6b00-40ee-ae80-626e835b9f73 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:12.558060 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-094c23a9-6b00-40ee-ae80-626e835b9f73 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:12.558608 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-094c23a9-6b00-40ee-ae80-626e835b9f73 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:12.696547 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.policy [None req-094c23a9-6b00-40ee-ae80-626e835b9f73 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:12.704433 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-094c23a9-6b00-40ee-ae80-626e835b9f73 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.166924 Jun 03 13:30:12.705346 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 549/1105] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:12 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:13.721873 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-c543ea56-fcbd-420b-b0c9-cbe06b381c08 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:13.722770 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-c543ea56-fcbd-420b-b0c9-cbe06b381c08 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:13.729490 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c543ea56-fcbd-420b-b0c9-cbe06b381c08 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:13.730021 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c543ea56-fcbd-420b-b0c9-cbe06b381c08 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:13.731010 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c543ea56-fcbd-420b-b0c9-cbe06b381c08 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:13.731767 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-c543ea56-fcbd-420b-b0c9-cbe06b381c08 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:13.878825 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-c543ea56-fcbd-420b-b0c9-cbe06b381c08 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:13.886987 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-c543ea56-fcbd-420b-b0c9-cbe06b381c08 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1565 microversion: 2.1 time: 0.169255 Jun 03 13:30:13.887541 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 557/1106] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:13 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:14.705387 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [req-e721e597-6f8a-413b-9011-4e54ac15a34c req-7b9ee4b4-a006-4257-a6ff-d7abfd06a2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9929c65e-650b-4a35-8e7e-fc7ce0c9defb", "name": "network-vif-deleted", "tag": "121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f"}]} {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 13:30:14.713960 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-e721e597-6f8a-413b-9011-4e54ac15a34c req-7b9ee4b4-a006-4257-a6ff-d7abfd06a2f6 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:14.714659 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [req-e721e597-6f8a-413b-9011-4e54ac15a34c req-7b9ee4b4-a006-4257-a6ff-d7abfd06a2f6 service nova] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:14.725809 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.compute.server_external_events [req-e721e597-6f8a-413b-9011-4e54ac15a34c req-7b9ee4b4-a006-4257-a6ff-d7abfd06a2f6 service nova] Creating event network-vif-deleted:121e1a6a-e38d-4cdd-a5e2-37a57d8dfa2f for instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb on hv-cinder-77954 Jun 03 13:30:14.731047 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [req-e721e597-6f8a-413b-9011-4e54ac15a34c req-7b9ee4b4-a006-4257-a6ff-d7abfd06a2f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029226 Jun 03 13:30:14.731682 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 550/1107] 10.222.0.58 () {64 vars in 1317 bytes} [Fri Jun 3 13:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 13:30:14.904838 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-ec78f5a0-dedc-4219-9ab7-cf0af11491f7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:14.905376 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.compute.api [None req-ec78f5a0-dedc-4219-9ab7-cf0af11491f7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117727) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:14.913128 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec78f5a0-dedc-4219-9ab7-cf0af11491f7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:14.913595 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec78f5a0-dedc-4219-9ab7-cf0af11491f7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:14.916145 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec78f5a0-dedc-4219-9ab7-cf0af11491f7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:14.916637 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG oslo_concurrency.lockutils [None req-ec78f5a0-dedc-4219-9ab7-cf0af11491f7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117727) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:14.990077 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.policy [None req-ec78f5a0-dedc-4219-9ab7-cf0af11491f7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9294e649dc51425ba978e70f4635ddb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb24e89507a54ec080cbb570f57ae7df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117727) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 13:30:15.001420 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-ec78f5a0-dedc-4219-9ab7-cf0af11491f7 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 200 len: 1218 microversion: 2.1 time: 0.100701 Jun 03 13:30:15.001997 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 558/1108] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:14 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 13:30:16.024457 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6e39f22e-8343-467e-8d05-2d27764aae04 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '>' {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:16.026435 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.compute.api [None req-6e39f22e-8343-467e-8d05-2d27764aae04 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] [instance: 9929c65e-650b-4a35-8e7e-fc7ce0c9defb] Fetching instance by UUID {{(pid=117726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 13:30:16.041843 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6e39f22e-8343-467e-8d05-2d27764aae04 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:16.042911 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6e39f22e-8343-467e-8d05-2d27764aae04 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:16.044090 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6e39f22e-8343-467e-8d05-2d27764aae04 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 13:30:16.044762 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG oslo_concurrency.lockutils [None req-6e39f22e-8343-467e-8d05-2d27764aae04 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Lock "55a1a63d-d44c-44ec-ac39-183e23168b3e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 13:30:16.065135 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.wsgi [None req-6e39f22e-8343-467e-8d05-2d27764aae04 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] HTTP exception thrown: Instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb could not be found. Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6e39f22e-8343-467e-8d05-2d27764aae04 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Request method failure captured: Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: request: GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb HTTP/1.1 Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept: application/json Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Accept-Encoding: identity Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Connection: close Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Length: 0 Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Content-Type: application/json Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Host: 10.222.0.58 Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Openstack-System-Scope: None Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: User-Agent: python-urllib3/1.26.9 Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Auth-Token: gAAAAABimgu7mjlp6KobVBd9BHgCqwx6IMbiYp2wR-K0qvGAB8zppixaqQDXU_QPv5S-JAXZbcBGJtFKVtBRbCf_y2Mxd1ARH2-mTUz4AYBkEoLIqel3yljojajEQCg0FCggtie2gWAstxI71xYm38ZLcZatQ8xBipgEQBgJHZH1fSh4-0j9e7M Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Id: None Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Domain-Name: None Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Identity-Status: Confirmed Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Is-Admin-Project: True Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Id: default Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Domain-Name: Default Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Id: eb24e89507a54ec080cbb570f57ae7df Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Project-Name: tempest-TestShelveInstance-686014578 Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Role: member,reader Jun 03 13:30:16.066952 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Roles: member,reader Jun 03 13:30:16.068716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eb24e89507a54ec080cbb570f57ae7df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.58:8080", "publicURL": "http://10.222.0.58:8080/v1/AUTH_eb24e89507a54ec080cbb570f57ae7df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/eb24e89507a54ec080cbb570f57ae7df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eb24e89507a54ec080cbb570f57ae7df"}]}] Jun 03 13:30:16.068716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant: tempest-TestShelveInstance-686014578 Jun 03 13:30:16.068716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Id: eb24e89507a54ec080cbb570f57ae7df Jun 03 13:30:16.068716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-Tenant-Name: tempest-TestShelveInstance-686014578 Jun 03 13:30:16.068716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User: tempest-TestShelveInstance-686014578-project Jun 03 13:30:16.068716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Id: default Jun 03 13:30:16.068716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Domain-Name: Default Jun 03 13:30:16.068716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Id: 9294e649dc51425ba978e70f4635ddb6 Jun 03 13:30:16.068716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: X-User-Name: tempest-TestShelveInstance-686014578-project Jun 03 13:30:16.068716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: method: > Jun 03 13:30:16.068716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: exception: Instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb could not be found. Jun 03 13:30:16.068716 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: action_args: {'id': '9929c65e-650b-4a35-8e7e-fc7ce0c9defb'} Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: {{(pid=117726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb could not be found. Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 13:30:16.070213 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb could not be found. Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb could not be found. Jun 03 13:30:16.072786 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: ERROR nova.api.openstack.wsgi Jun 03 13:30:16.074440 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: DEBUG nova.api.openstack.wsgi [None req-6e39f22e-8343-467e-8d05-2d27764aae04 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Returning 404 to user: Instance 9929c65e-650b-4a35-8e7e-fc7ce0c9defb could not be found. {{(pid=117726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 13:30:16.074440 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO nova.api.openstack.requestlog [None req-6e39f22e-8343-467e-8d05-2d27764aae04 tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb" status: 404 len: 111 microversion: 2.1 time: 0.051872 Jun 03 13:30:16.074440 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: [pid: 117726|app: 0|req: 551/1109] 10.222.0.58 () {58 vars in 1235 bytes} [Fri Jun 3 13:30:16 2022] GET /compute/v2.1/servers/9929c65e-650b-4a35-8e7e-fc7ce0c9defb => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 13:30:16.252487 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: DEBUG nova.api.openstack.wsgi [None req-1fd9aee5-cfac-4516-a81d-f14ebbe112eb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] Calling method '.version_select at 0x7fc5a4312b80>' {{(pid=117727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 13:30:16.281544 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO nova.api.openstack.requestlog [None req-1fd9aee5-cfac-4516-a81d-f14ebbe112eb tempest-TestShelveInstance-686014578 tempest-TestShelveInstance-686014578-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2129754850" status: 202 len: 0 microversion: 2.1 time: 0.032732 Jun 03 13:30:16.282225 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: [pid: 117727|app: 0|req: 559/1110] 10.222.0.58 () {58 vars in 1253 bytes} [Fri Jun 3 13:30:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2129754850 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 13:31:42.157970 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:31:42.159040 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Fri Jun 3 13:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:32:19.997707 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:32:19.998750 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Fri Jun 3 13:32:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:32:36.456967 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:32:36.457918 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Fri Jun 3 13:32:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:32:38.912004 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:32:38.912924 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Fri Jun 3 13:32:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:32:40.382080 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:32:40.382863 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Fri Jun 3 13:32:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:34:03.673839 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:34:03.674505 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Fri Jun 3 13:34:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:35:02.171515 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:35:02.172705 dv-cinder-779540-3-iscsi devstack@n-api.service[117726]: Fri Jun 3 13:35:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 13:35:40.009434 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 13:35:40.010135 dv-cinder-779540-3-iscsi devstack@n-api.service[117727]: Fri Jun 3 13:35:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!